Description

Elasticsearch and Elastic Stack are important tools for managing massive data. You need to know the problems it solves and how it works to design the best systems and be the most valuable engineer you can be. Explore Elasticsearch 8 and learn to manage operations on your Elastic Stack with this comprehensive course. This course covers it all, from installation to operations.

Elasticsearch 8 is a powerful tool for analyzing big datasets in a matter of milliseconds! It's an increasingly popular technology for powering search and analytics on big websites, and a valuable skill to have in today's job market. The course starts with setting up search indices on an Elasticsearch 8 cluster and querying that data in many ways. Fuzzy searches, partial matches, search-as-you-type, pagination, sorting. Next, you will explore what's new in Elasticsearch 8 and illustrate all the new syntax requirements of Elasticsearch commands. Elasticsearch isn't just for search anymore-it has powerful aggregation capabilities for structured data, which allows you to glean new insights from your indexed data. You will learn to bucket and analyze data using Elasticsearch, and visualize it using the Elastic Stack's web UI, Kibana, and Kibana Lens. You will learn how to manage operations on your Elastic Stack, monitor your cluster's health, and perform operational tasks such as scaling up your cluster and doing rolling restarts. We will also spin up Elasticsearch clusters in the cloud using Amazon Opensearch Service and the Elastic Cloud. By the end of this course, you will develop the Elasticsearch skills needed for searching, analyzing, and visualizing big data. All resources and code files are placed here: https://github.com/packtpublishing/elasticsearch-7-and-elastic-stack---in-depth-and-hands-on-

What You Will Learn

Install and configure Elasticsearch 8 on a cluster
Find out how to create search indices and mappings
Use Logstash to import streaming log data into Elasticsearch
Aggregate structured data using buckets and metrics
Use Filebeat and Elastic Stack to import streaming data at scale
Manage operations on Elasticsearch clusters

Audience

This course is designed for anyone who is looking to learn Elasticsearch to search and analyze big datasets. A basic understanding of web services and REST API is needed to get started with this course.

Approach

With the help of interesting activities, you will explore what is new in Elasticsearch 8. You will learn how to search, analyze, and visualize big datasets quickly and easily, and understand the process of building Elasticsearch clusters in the cloud.

Key Features

Find about the different techniques used to import data into Elasticsearch * Learn how to analyze and visualize data in Elasticsearch using Kibana * Integrate Elasticsearch with other systems, such as Spark, Kafka, relational databases, S3, and more

Github Repo

https://github.com/packtpublishing/elasticsearch-7-and-elastic-stack---in-depth-and-hands-on-

About the Author

Frank Kane

Frank Kane has spent nine years at Amazon and IMDb, developing and managing the technology that automatically delivers product and movie recommendations to hundreds of millions of customers all the time. He holds 17 issued patents in the fields of distributed computing, data mining, and machine learning. In 2012, Frank left to start his own successful company, Sundog Software, which focuses on virtual reality environment technology and teaches others about big data analysis.

Course Outline

1. Installing and Understanding Elasticsearch

1. Section1 Introduction

This video demonstrates how to install Elasticsearch and introduces Elasticsearch.

2. Installing Elasticsearch (Step-by-Step)

This video demonstrates how to install Elasticsearch.

3. Overview of Elasticsearch

This video provides an overview of Elasticsearch.

4. Introducing HTTP and RESTful APIs

This video introduces HTTP and RESTful APIs.

5. Elasticsearch Basics: Logical Concepts

This video explains the logical concepts of Elasticsearch.

6. Term Frequency/Inverse Document Frequency (TF/IDF)

This video explains the concept of TF/IDF.

7. Using Elasticsearch

This video demonstrates how to use Elasticsearch.

8. What's New in Elasticsearch 8?

This video highlights the new features of Elasticsearch 8.

9. How Elasticsearch Scales

This video explains how Elasticsearch scales.

10. Quiz: Elasticsearch Concepts and Architecture

This video presents a quiz on Elasticsearch concepts and architecture.

11. Section 1 Wrap-Up

This video summarizes what you have learned in this section.

2. Mapping and Indexing Data

1. Section 2 Introduction

This video introduces you to the concepts of mapping and indexing data.

2. Connecting to Your Cluster

This video demonstrates how to connect to your cluster.

3. Introducing the MovieLens Dataset

This video introduces you to the MovieLens dataset.

4. Analyzers

This video explains the concept of analyzers.

5. Import a Single Movie through JavaScript Object Notation/Representational State Transfer (JSON/REST) API

This video demonstrates how to import a single movie through JSON/REST API.

6. Inserting Many Movies at Once with Bulk API

This video demonstrates how to insert many movies at once with bulk API.

7. Updating Data in Elasticsearch

This video demonstrates how to update data in Elasticsearch.

8. Deleting Data in Elasticsearch

This video demonstrates how to delete data in Elasticsearch.

9. (Exercise) Inserting, Updating, and Deleting a Movie

This video presents an exercise on how to insert, update, and delete a movie.

10. Dealing with Concurrency

This video explains how to deal with concurrency.

11. Using Analyzers and Tokenizers

This video explains how to map and index data using analyzers and tokenizers.

12. Data Modeling and Parent/Child Relationships - Part 1

This is the first part of the two-part video that introduces data modeling and parent/child relationships in mapping and indexing data.

13. Data Modeling and Parent/Child Relationships - Part 2

This is the second part of the two-part video that explains data modeling and parent/child relationships in mapping and indexing data.

14. Flattened Datatype

This video explains the flattened data type.

15. Dealing with Mapping Extensions

This video explains how to deal with mapping extensions.

16. Section 2 Wrap-Up

This video summarizes what you have learnt in this section.

3. Searching with Elasticsearch

1. Section 3 Introduction

This video introduces searching with Elasticsearch.

2. Query Lite Interface

This video explains how to search with Elasticsearch using the "Query Lite" interface.

3. JavaScript Object Notation (JSON) Search In-Depth

This video explains how to search with Elasticsearch using JSON Search In-Depth.

4. Phrase Matching

This video explains phrase matching while searching with Elasticsearch.

5. (Exercise) Querying in Different Ways

This video presents an exercise to practice how to query in different ways while searching with Elasticsearch.

6. Pagination

This video explains the concept of pagination.

7. Sorting

This video focuses on the concept of sorting.

8. More with Filters

This video explains how to use filters.

9. (Exercise) Using Filters

This video presents an exercise on filters.

10. Fuzzy Queries

This video explains how to use fuzzy queries while searching with Elasticsearch.

11. Partial Matching

This video focuses on partial matching while searching with Elasticsearch.

12. Query-Time Search-As-You-Type

This video explains how to use query-time Search-as-you-Type.

13. N-Grams - Part 1

This is the first part of the two-part video that explains how to use N-Grams while searching with Elasticsearch.

14. N-Grams - Part 2

This is the second part of the two-part video that explains how to use N-Grams while searching with Elasticsearch.

15. "Search-As-You-Type" Field Type

This video explains how to use the "Search-as-you-Type" field type.

16. Section 3 Wrap-Up

This video summarizes what you have learned in this section.

4. Importing Data into Your Index - Big or Small

1. Section 4 Introduction

This video explains how to import data into your index.

2. Importing Data with a Script

This video explains how to import data with a script.

3. Importing Data with Client Libraries

This video explains how to import data with client libraries.

4. (Exercise) Importing Data with a Script

This video presents an exercise on importing data into your index.

5. Introducing Logstash

This video introduces Logstash.

6. Installing Logstash

This video demonstrates how to install Logstash.

7. Running Logstash

This video demonstrates how to run Logstash.

8. Logstash and MySQL - Part 1

This is the first part of the two-part video that explains how to use Logstash and MySQL to import data into your index.

9. Logstash and MySQL - Part 2

This is the second part of the two-part video that explains how to use Logstash and MySQL to import data into your index.

10. Importing Comma Separated Values (CSV) Data with Logstash

This video demonstrates how to import CSV data with Logstash.

11. Importing JavaScript Object Notation (JSON) Data with Logstash

This video demonstrates how to import JSON data with Logstash.

12. Logstash and Simple Storage Service (S3)

This video explains how to import data into your index using Logstash and the S3 input plug-in.

13. Parsing and Filtering Logstash with Grok

This video explains how to parse and filter Logstash with Grok.

14. Logstash Grok Examples for Common Log Formats

This video provides some Logstash Grok examples for common log formats.

15. Logstash Input Plug-Ins -Part 1: Heartbeat

This is the first part of the four-part video that explains the "Heartbeat" input plug-in in Logstash.

16. Logstash Input Plug-Ins -Part 2: Generator Input and Dead Letter Queue

This is the second part of the four-part video that explains the "Generator Input and Dead Letter Queue" input plug-in in Logstash.

17. Logstash Input Plug-Ins -Part 3: HTTP Poller

This is the third part of the four-part video that explains the "HTTP Poller" input plug-in in Logstash.

18. Logstash Input Plug-Ins -Part 4: Twitter

This is the fourth part of the four-part video that explains the "Twitter" input plug-in in Logstash.

19. Syslog with Logstash Deep Dive

This video explains Syslog with Logstash in detail.

20. Elasticsearch and Kafka - Part 1

This is the first part of the two-part video that explains Elasticsearch and Kafka.

21. Elasticsearch and Kafka - Part 2

This is the second part of the two-part video that explains Elasticsearch and Kafka.

22. Elasticsearch and Apache Spark - Part 1

This is the first part of the two-part video that explains Elasticsearch and Apache Spark.

23. Elasticsearch and Apache Spark - Part 2

This is the second part of the two-part video that explains Elasticsearch and Apache Spark.

24. (Exercise) Importing Data with Spark

This video presents an exercise on importing data with Spark.

25. Section 4 Wrap-Up

This video provides a summary of what you have learned in this section.

5. Using Aggregation

1. Section 5 Introduction

This video introduces aggregation in Elasticsearch.

2. Aggregations, Buckets, and Metrics

This video focuses on the concepts of aggregation, buckets, and metrics.

3. Histograms

This video explains how aggregations help in creating histogram data.

4. Time Series

This video explains how to aggregate time series data with Elasticsearch.

5. (Exercise) Generating Histogram Data

This video presents an exercise to generate histogram data using aggregation.

6. Nested Aggregations - Part 1

This is the first part of the two-part video that explains nested aggregations in Elasticsearch.

7. Nested Aggregations - Part 2

This is the second part of the two-part video that explains nested aggregations in Elasticsearch.

8. Section 5 Wrap-up

This video summarizes what you have learned in this section.

6. Using Kibana

1. Section 6 Introduction

This video introduces Kibana.

2. Installing Kibana

This video demonstrates how to install Kibana.

3. Playing with Kibana

This video demonstrates how to work with the Kibana interface.

4. (Exercise) Exploring Data with Kibana

This video presents an exercise on exploring data with Kibana.

5. Kibana Lens

This video focuses on the Kibana Lens User Interface (UI).

6. Kibana Management

This video explains how to manage Kibana effectively.

7. Elasticsearch SQL

This video introduces the Elasticsearch SQL feature.

8. Using the Kibana Canvas

This video demonstrates how to use the Kibana canvas.

9. Elasticsearch and Apache Hadoop

This video explains Elasticsearch and Apache Hadoop.

10. Section 6 Wrap-Up

This video presents a summary of what you have learned in this section.

7. Analyzing Log Data with the Elastic Stack

1. Section 7 Introduction

This video introduces you to log data analysis using Elastic Stack.

2. Data Frame Transforms

This video explains the data frame transforms feature in Elastic Stack.

3. FileBeat and the Elastic Stack Architecture

This video provides an overview of FileBeat and the Elastic Stack architecture.

4. X-Pack Security

This video explains the X-Pack security extension in Elastic Stack.

5. Installing FileBeat

This video demonstrates how to install FileBeat.

6. Analyzing Logs with Kibana Dashboards

This video demonstrates how to analyze log data using Kibana dashboards.

7. (Exercise) Log Analysis with Kibana

This video presents an exercise to analyze log data using Kibana.

8. Section 7 Wrap-up

This video summarizes what you have learned in this section.

8. Elasticsearch Operations

1. Section 8 Introduction

This video explains the concept of Elasticsearch operations and its support with SQL.

2. Choosing the Right Number of Shards

This video explains how to select the right number of shards.

3. Adding Indices as a Scaling Strategy

This video demonstrates how to add indices as a scaling strategy.

4. Index Alias Rotation

This video explains how to rotate index alias.

5. Index Lifecycle Management

This video explains how to manage indices through effective index lifecycle management.

6. Choosing Your Cluster's Hardware

This video explains how to select the hardware for your cluster.

7. Heap Sizing

This video explains heap sizing in Elasticsearch.

8. Monitoring

This video explains monitoring in Elasticsearch.

9. Troubleshooting Common Issues

This video focuses on troubleshooting common issues faced in Elasticsearch.

10. Failover in Action - Part 1

This is the first part of the two-part video that explains the concept of failover in action.

11. Index Design Changes

This video focuses on changes in the index design.

12. Snapshots

This video explains snapshots in Elasticsearch.

13. Snapshots Lifecycle Management

This video explains snapshot lifecycle management.

14. Rolling Restarts

This video explains the concept of rolling restarts.

15. Uptime Monitoring with Heartbeat

This video explains how to perform uptime monitoring effectively using Heartbeat.

16. Section 8 Wrap-up

This video presents a summary of this section.

9. Elasticsearch in the Cloud

1. Section 9 Introduction

This video introduces the concept of Elasticsearch in the Cloud.

2. Amazon Elasticsearch Service - Part 1

This is the first part of the two-part video that explains the functions of Amazon Elasticsearch Service.

3. Amazon Elasticsearch Service, Part 2

This is the second part of the two-part video that explains the functions of Amazon Elasticsearch Service.

4. The Elastic Cloud

This video introduces the concept of the Elastic Cloud.

5. Section 9 Wrap-Up

This video presents a summary of what you have learned in this section.

10. You Made It!

1. Wrapping Up

This video presents a summary of the entire course.

Course Images

Elasticsearch 8 and the Elastic Stack: In-Depth and Hands-On

By Packt

Booking options

Highlights

Description

Course Content

About The Provider

Tags

Reviews