Datadog + Spring Boot QuickStart

First things first, we can generate the starter project using https://start.spring.io/. Select these dependencies: Then, using documentation here we should set API Key, Application Key and Datadog URI in application.properties file: You can get your API Key and Datadog URI from startup Datadog screen: By the way, Datadog has a trial period. Application Key can […]

READ MORE

DataDog log search syntax

Suppose we want to find some log entry in DataDog. In this article you’ll find the answers to these questions: First of all, there is an official doc: https://docs.datadoghq.com/logs/explorer/search_syntax. However, from my point of view, this page is not entirely clear; there are still a number of blind spots. There are two types of searches: […]

READ MORE

Yarn is not aggregating application logs

First of all, you need to check NodeManager logs. There may be at least two problems: Log aggregation is not initialized problem: https://mchesnavsky.tech/log-aggregation-is-not-initialized HDFS DELEGATION TOKEN can’t be found in cache problem: https://mchesnavsky.tech/hdfs-delegation-token-cant-be-found-in-cache Please, refer to corresponding article, or made a note in comments below, if you have any other problem.

READ MORE

Log aggregation is not initialized

You may encounter with Hadoop Yarn exception in NodeManager logs that states: It may happen because NM reboot. The newly launched NM inherited the running application, and it does not know how to collect logs from it.According to the Hadoop Yarn NodeManager source code, instances of log collector classes for each running application are stored […]

READ MORE