Skip to content

[BUG] write warm index error because execption of index file Already closed #20054

@liuyonghengheng

Description

@liuyonghengheng

Describe the bug

when we writing a warm index,the index break whith execption:
Image

Related component

Storage

To Reproduce

  1. config and start server:
## this feature is not release
opensearch.experimental.feature.writable_warm_index.enabled: true

node.search.cache.size: 1gb
cluster.filecache.remote_data_ratio: 5

s3.client.default.endpoint: **** # S3 has alternate endpoints, but you probably don't need to change this value.
s3.client.default.max_retries: 3 # number of retries if a request fails
s3.client.default.path_style_access: true # whether to use the deprecated path-style bucket URLs.
s3.client.default.protocol: http # http or https
s3.client.default.read_timeout: 50s # the S3 connection timeout
s3.client.default.use_throttle_retries: true # whether the client should wait a progressively longer amount of time (exponential backoff) between each successive retry
s3.client.default.region: **** # AWS region to use. For non-AWS S3 storage, this value is required but has no effect.

# Repository name
node.attr.remote_store.segment.repository: warm-repo-1
node.attr.remote_store.translog.repository: warm-repo-1
node.attr.remote_store.state.repository: warm-repo-1
# Segment repository settings
node.attr.remote_store.repository.warm-repo-1.type: s3
node.attr.remote_store.repository.warm-repo-1.settings.bucket: test-warm
#node.attr.remote_store.repository.warm-repo-1.settings.base_path: data1013
node.attr.remote_store.repository.warm-repo-1.settings.region: ****

cluster.remote_store.state.enabled: false #stores index metadata in the remote store
  1. continuously writing data
  2. error:
org.apache.lucene.store.AlreadyClosedException: Already closed: MemorySegmentIndexInput(path="/opt/workspace/apps/test/ssnap/opensearch-3.4.0-SNAPSHOT/data/nodes/0/indices/XIZHZhb3R06MfB_vjsg1Rw/0/index/_2e_Lucene103_0.tip")

Expected behavior

no error

Additional Details

Plugins
Please list all plugins currently enabled.

Screenshots
If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

  • OS: [e.g. iOS]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    StorageIssues and PRs relating to data and metadata storagebugSomething isn't working

    Type

    No type

    Projects

    Status

    🆕 New

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions