OpenSearch

Deploy OpenSearch for application search, log analytics, observability, or security analytics with storage and access controls planned up front.

On this page

Scope and fit

OpenSearch is a community-driven search and analytics suite made up of the OpenSearch engine, OpenSearch Dashboards, and related ingestion components. Organizations can run it as a self-managed foundation for application search, operational telemetry, or security analysis.

Search, ingest, and explore data

The OpenSearch engine indexes data for search and analytics, while Dashboards provides a visual interface for exploring it. Data Prepper and language clients can support ingestion and application integration, depending on the architecture.

Use it for the workloads that fit

OpenSearch can support several patterns, from product search to log investigation and observability. These workloads have different indexing, query, and retention profiles, so separating them in the design helps avoid competing resource demands.

Design the cluster for its data

Plan shard and replica strategy, storage growth, availability zones, snapshot destinations, and access controls using expected ingestion and query patterns. A production rollout should also test upgrades, rebalancing, and restore times with representative data.

Decisions and tradeoffs

Use this table as a working review record. Replace assumptions with evidence from the target environment.

Decision areaWorking guidance
Search, ingest, and explore dataThe OpenSearch engine indexes data for search and analytics, while Dashboards provides a visual interface for exploring it. Data Prepper and language clients can support ingestion and application integration, depending on the architecture.
Use it for the workloads that fitOpenSearch can support several patterns, from product search to log investigation and observability. These workloads have different indexing, query, and retention profiles, so separating them in the design helps avoid competing resource demands.
Design the cluster for its dataPlan shard and replica strategy, storage growth, availability zones, snapshot destinations, and access controls using expected ingestion and query patterns. A production rollout should also test upgrades, rebalancing, and restore times with representative data.

Implementation questions

What should the team decide about search, ingest, and explore data?

The OpenSearch engine indexes data for search and analytics, while Dashboards provides a visual interface for exploring it. Data Prepper and language clients can support ingestion and application integration, depending on the architecture. Use a named owner and a written acceptance check so this decision can be reviewed after deployment.

What should the team decide about use it for the workloads that fit?

OpenSearch can support several patterns, from product search to log investigation and observability. These workloads have different indexing, query, and retention profiles, so separating them in the design helps avoid competing resource demands. Use a named owner and a written acceptance check so this decision can be reviewed after deployment.

What should the team decide about design the cluster for its data?

Plan shard and replica strategy, storage growth, availability zones, snapshot destinations, and access controls using expected ingestion and query patterns. A production rollout should also test upgrades, rebalancing, and restore times with representative data. Use a named owner and a written acceptance check so this decision can be reviewed after deployment.

Plan, build, verify, operate

Search, ingest, and explore data: The OpenSearch engine indexes data for search and analytics, while Dashboards provides a visual interface for exploring it. Data Prepper and language clients can support ingestion and application integration, depending on the architecture. Record the result and the next owner before changing the next boundary.

Deployment checks

Turn the page into a reviewable handover by assigning each check to a person and retaining its result.

Full-text and structured search

Search, ingest, and explore data: Full-text and structured search. Confirm the owner, input, evidence, and acceptance check before this work moves into production.

Dashboards for analysis and visualization

Search, ingest, and explore data: Dashboards for analysis and visualization. Confirm the owner, input, evidence, and acceptance check before this work moves into production.

Extensible integrations and plugins

Search, ingest, and explore data: Extensible integrations and plugins. Confirm the owner, input, evidence, and acceptance check before this work moves into production.

Application and site search

Use it for the workloads that fit: Application and site search. Confirm the owner, input, evidence, and acceptance check before this work moves into production.

Log and security-event analysis

Use it for the workloads that fit: Log and security-event analysis. Confirm the owner, input, evidence, and acceptance check before this work moves into production.

Operational dashboards and alerting

Use it for the workloads that fit: Operational dashboards and alerting. Confirm the owner, input, evidence, and acceptance check before this work moves into production.

Index lifecycle and recovery

OpenSearch is a distributed search and analytics engine; OpenSearch Dashboards is the interface used to query and visualize stored data. Treat the index design as an application contract. A product-search index, an audit-log index, and a metrics index have different mappings, write rates, query patterns, and retention needs. Mixing them without boundaries makes capacity and access decisions hard to explain.

Define an index naming convention, mappings, shard count, replicas, and rollover or deletion policy before bulk ingestion. Test mappings with awkward real values: long strings, missing fields, changing schemas, timestamps with offsets, and repeated identifiers. Mapping changes can require reindexing, so an informal field change from an upstream producer should have an owner and a release path.

Cluster topology follows failure domains and workload. Separate manager responsibilities from data and ingest pressure where the chosen topology requires it, and state which node roles are allowed in each environment. Size from observed indexing throughput, stored data, query concurrency, and recovery time objectives rather than from document count alone. A cluster needs disk space to rebalance and recover, not merely to accept today's writes.

Snapshots are the recovery mechanism for indexed data. Select a repository that the cluster can access, grant the smallest practical permissions, monitor snapshot completion, and perform a restoration test into an isolated target. A successful snapshot job does not prove that index settings, access configuration, dashboards, or the expected data can be restored in the required time.

For handover, retain the data catalogue, role map, index policies, dashboard ownership, snapshot result history, and an upgrade rehearsal. The operational question is simple: when a search is slow, storage approaches a threshold, or a node leaves the cluster, who can identify the affected workload and make the next safe change?

Handover and ownership

Before handover, name the system owner, support path, access boundary, backup or recovery responsibility, and the condition that pauses a change.

Keep a short record of what was tested, what remains outside scope, and when the review should happen again.

Sources and further reading

Talk to our team.

Tell us what you're working on, whether it's a deployment, an audit, a security test or a cyber range. You'll speak with an engineer who can help you scope it.

  • 30-minute call: free, with no obligation.
  • NDA on request: we can sign before you share details.
  • Clear next steps: a scope and plan after the call.