simply about difficult
You may encounter with Hadoop Yarn exception in NodeManager logs that states: It may happen because NM reboot. The newly launched NM inherited the running application, and it does not know how to collect logs from it.According to the Hadoop Yarn NodeManager source code, instances of log collector classes for each running application are stored […]
READ MOREFull exception text: This can happen when some process overwrites application files in HDFS application directory while app is running. An example of the situation: You start app instance_1, which stores the distribution files in the hdfs://tmp/app folder. After a while you start the second instance_2 which stores the distribution files in the same HDFS […]
READ MOREImagine an error or exception occurs while running the Spring Boot Yarn container, and we need to kill container from itself and return an error code. You can use @OnContainerStart annotation as mentioned in this article: https://mchesnavsky.tech/how-to-set-up-exit-code-on-spring-boot-yarn-container. But if we need to stop the container immediately, we just need to call: – where parameter is […]
READ MOREIn the previous article, we already figured out how to terminate a container with a specific exit code. To begin with, the return value must be smaller then 256. You can notice that: If you terminate the container with a code of 0 or some other positive number, then the same code will be sent […]
READ MOREYou need to mark container’s start class using the @YarnComponent and mark method with the @OnContainerStart annotations: Despite the fact that the description of the annotation says that it cannot return anything, the return value works. We make the return value of type int. 0 – means successful shutdown of the container, non-zero values – […]
READ MORESuppose that we have an SBY application, which includes AppMaster and Container. When the container falls due to an exception, we need to send exception text to the AppMaster. When the container falls, the AppMaster’s onContainerFailed() method is automatically called: The method is in the StaticEventingAppmaster class. Your AppMaster must be inherited from it. We […]
READ MORE