Big Data

Create an OpenSearch dashboard with Amazon OpenSearch Service

agosto 13, 2025
techhdesign


Efficient log evaluation is important for sustaining the well being and efficiency of recent functions. Amazon OpenSearch Service stands out as a robust, totally managed answer for log analytics and observability. With its superior indexing, full-text search, and real-time analytics capabilities, OpenSearch Service makes it doable for organizations to seamlessly ingest, course of, and search log knowledge throughout various sources—together with AWS companies like Amazon CloudWatch, VPC Stream Logs, and extra.

With OpenSearch Dashboards, you may flip listed log knowledge into actionable visualizations that reveal insights and assist detect anomalies. By querying knowledge saved in OpenSearch Service, you may extract related info and show it utilizing a wide range of visualization varieties—similar to line charts, bar graphs, pie charts, heatmaps, and extra. These instruments make it easy to observe system habits, spot traits, and shortly establish points in your setting.

This submit demonstrates the best way to harness OpenSearch Dashboards to research logs visually and interactively. With this answer, IT directors, builders, and DevOps engineers can create customized dashboards to observe system habits, detect anomalies early, and troubleshoot points sooner by means of interactive charts and graphs.

Answer overview

On this submit, we present the best way to create an index sample in OpenSearch Dashboards, create two kinds of visualizations, and show these visualizations on a customized dashboard. We additionally show the best way to export and import visualizations.

Conditions

Earlier than diving into log evaluation with OpenSearch Dashboards, it’s essential to have the next:

  • A correctly configured OpenSearch Service area
  • A working log assortment and ingestion pipeline

Amazon OpenSearch Service 101: Create your first search utility with OpenSearch guides you thru organising your OpenSearch Service area and configuring the log ingestion pipeline.

For this submit, we work with the next log sources, which have already been ingested into an OpenSearch Service cluster as a part of the prerequisite steps:

Entry OpenSearch Dashboards

Full the next steps to entry OpenSearch Dashboards:

  1. On the OpenSearch Service console, select Domains within the navigation pane.
  2. Examine in case your area standing exhibits as Lively.
  3. Select your area to open the area particulars web page.
  4. Select the OpenSearch Dashboards URL to open it in a brand new browser window.

  1. Authenticate into OpenSearch Dashboards utilizing one of many supported strategies.

Create an index sample

After you’re logged in to OpenSearch Dashboards, it’s essential to create an index sample. An index sample permits OpenSearch Dashboards to find indexes to go looking. Full the next steps

  1. In OpenSearch Dashboards, develop the navigation pane and select Dashboard Administration beneath Administration.
  2. Select Index patterns within the navigation pane.

  1. Select Create index sample.
  2. For Index sample title, enter a reputation (for instance, log-aws-cloudtrail-*).
  3. Select Subsequent step.

  1. For Time discipline¸ select @timestamp.
  2. Select Create index sample.

Create visualizations

Now that the index sample is created, let’s create some visualizations. For this submit, we create a pie chart and an space graph.

Create a pie chart

Full the next steps to create a pie chart:

  1. In OpenSearch Dashboards, select Visualize within the navigation pane.

  1. Select Create visualization.

  1. Select Pie because the visualization kind.
  2. For Supply¸ select log-aws-cloudtrail-*.

  1. Beneath Buckets¸ select Add and Break up slices.

  1. For Aggregation, select Phrases.

  1. For Subject, select eventName.
  2. For Dimension, enter 10.

  1. Depart all different parameters as default and select Replace.
  2. Select Save to save lots of the visualization.

Pattern ndjson file for the pie chart – EventNamePie.ndjson

Please refer Export and import visualizations for the best way to import the samples.

The next screenshot exhibits our pie chart, which shows various kinds of occasions and their prevalence share within the final half-hour.

Create an space graph

Full the next steps to create an space graph:

  1. In OpenSearch Dashboards, select Visualize within the navigation pane.
  2. Select Create visualization.
  3. Select Space because the visualization kind.

  1. For Supply¸ select log-aws-cloudtrail-*.

  1. Beneath Buckets¸ select Add and X-axis.

  1. For Aggregation, select Date Histogram.
  2. For Subject, select @timestamp.
  3. Depart all different parameters as default and select Replace

  1. Beneath Superior¸ select Add and Break up sequence.

  1. For Aggregation, select Phrases.
  2. For Subject, select eventName.
  3. For Dimension, enter 10.
  4. Depart all different parameters as default and select Replace.

  1. Select Save.
  2. Replace the time vary to Final 60 minutes.
  3. Select Refresh and Save.

The next screenshot exhibits an space graph with various kinds of occasions and their prevalence rely within the final 60 minutes.

Pattern ndjson file for Space chart – EventNameArea.ndjson

Please refer Export and import visualizations for the best way to import the samples.

Create a dashboard

Now we’ll mix the visualizations we simply created right into a dashboard. A dashboard serves as a customizable interface that consolidates a number of visualizations, saved searches, and varied content material right into a complete view of information. Customers can mix various visible parts—together with charts, graphs, metrics, and tables—right into a single cohesive show that may be organized and resized on a versatile grid structure. You’ll be able to concurrently apply filters and time ranges throughout a number of visualizations, making a coordinated analytical expertise. Full the next steps to create a dashboard:

  1. In OpenSearch Dashboards, select Dashboards within the navigation pane.
  2. Select Create new dashboard.

  1. Select Add on the menu bar.

  1. Seek for and select the visualizations you created.

You’ll be able to resize panels by dragging their corners to regulate dimensions. To switch the structure association, you may drag the highest portion of panels, which lets you arrange them horizontally in a row formation. When working with tabular visualizations, the system offers a handy choice to export your leads to CSV format for additional evaluation or reporting functions.

  1. Select Save.
  2. Change the time vary to Final 60 minutes.
  3. Select Refresh and Save.

Pattern ndjson file for dashboard – CloudTrailSummary.ndjson

Please refer Export and import visualizations for the best way to import the samples.

The next screenshot exhibits the CloudTrail dashboard displaying each visualizations.

Export and import visualizations

In OpenSearch, an NDJSON file is used to import and export saved objects, similar to dashboards, visualizations, maps, and index template. The NDJSON file offers a streamlined method for dealing with massive datasets by representing every JSON object on a separate line. This format allows environment friendly import/export operations, simplified knowledge migration between environments, and seamless sharing of complicated dashboard configurations. Organizations can again up and restore crucial visualizations, saved searches, and dashboard settings whereas sustaining their integrity. The format’s construction reduces reminiscence overhead throughout massive transfers and improves processing pace for bulk operations. NDJSON’s human-readable nature additionally facilitates troubleshooting and handbook modifying when mandatory, making it a useful device for sustaining OpenSearch Dashboards deployments throughout growth, testing, and manufacturing environments.

Export a visualization

Full the next steps to export a visualization:

  1. In OpenSearch Dashboards, select Saved objects within the navigation pane.
  2. Seek for and choose your object (on this case, a visualization), then select Export.

The NDJSON file is downloaded in your native host.

Import a visualization

Full the next steps to import a visualization:

  1. In OpenSearch Dashboards, select Saved objects within the navigation pane.
  2. Select Import.
  3. Select the primary NDJSON file to be imported out of your native host.
  4. Choose Create new objects with random IDs.
  5. Select Import.

  1. Select Executed.

  1. Select Import.

Now you can open the imported object.

The next screenshot exhibits our up to date dashboard.

Clear up

To scrub up your sources, delete the OpenSearch Service area and related info saved or visualizations created on the area. You won’t be able to get well the information after you delete it.

  1. On the OpenSearch Service console, select Domains within the navigation pane.
  2. Choose the area you created and select Delete.

Conclusion

OpenSearch Dashboards is a robust device for reworking uncooked log knowledge into actionable visualizations that drive insights and decision-making. On this submit, we’ve proven the best way to create visualizations like pie charts and space graphs, construct complete dashboards, and effectively export and import your work utilizing NDJSON recordsdata. Through the use of the totally managed OpenSearch Service options, organizations can give attention to extracting precious insights somewhat than managing infrastructure, finally enhancing their observability posture and operational effectivity.

To additional improve your OpenSearch proficiency, take into account exploring superior visualization choices similar to warmth maps, gauge charts, and geographic maps that may characterize your knowledge in additional specialised methods. Implementing automated alerting based mostly on predefined thresholds will assist you proactively establish anomalies earlier than they turn out to be crucial points. You can even use OpenSearch’s highly effective machine studying capabilities for classy anomaly detection and predictive analytics to achieve deeper insights out of your log knowledge. As your implementation grows, customizing safety settings with fine-grained entry controls will present acceptable knowledge visibility throughout completely different groups in your group.

For complete studying sources, seek advice from the Amazon OpenSearch Service Developer Information, watch Create your first OpenSearch Dashboard on YouTube, discover greatest practices in Amazon OpenSearch weblog posts, and acquire hands-on expertise by means of workshops out there in AWS Workshops.

In regards to the Authors

Smita Singh is a Senior Options Architect at AWS. She focuses on defining technical strategic imaginative and prescient and works on structure, design, and implementation of recent, scalable platforms for large-scale world enterprises and SaaS suppliers. She is an information, analytics, and generative AI fanatic and is enthusiastic about constructing modern, extremely scalable, resilient, fault-tolerant, self-healing, multi-tenant platform options and accelerators.

Dipayan Sarkar is a Specialist Options Architect for Analytics at AWS, the place he helps clients modernize their knowledge platform utilizing AWS analytics companies. He works with clients to design and construct analytics options, enabling companies to make data-driven choices.