How to manage YARN applications with Time line server?

In this article, we will discuss on how to configure and use time line server. The main objective of using timeline server is to manage YARN applications. It works in a very similar way as History server was doing.



The timeline server gives the following information like –

  • It is giving general details regarding completed Hadoop Application
Here generic details include the information like Hadoop application type, application attempts, users’ details, containers used for application, and detail for every single container. It is possible to extract generic details about completed apps by Web UI or you can use REST architecture as well.

  • Pre-framework details of completed and running Hadoop Application
Pre-framework details are very much specific to the Hadoop application or Hadoop Software and it includes information like maps, containers, counters etc. The information is published by Hadoop developers with the help of timeline server and rendered by Web UI or REST architecture.

Configuring Time line server and publishing pre-framework data using timeline server is a tough job and it generally requires technical assistance. Without technical background, it becomes very hard for any user to work on this particular server or similar frameworks.

Next achievement of Time line server – incredible Log management for Hadoop application or Hadoop Software

Log management in Hadoop was never as easy as it has been made now. Log management becomes crucial when handling errors in Hadoop, tuning up app performance or optimizing cluster capacity. As we have discussed previously, earlier History server was doing all these tasks and it has been taken by timeline server eventually. It has been optimized for better performance and used along with YARN applications.

It is useful when you have to collect details about any Hadoop application in single shot. In this dynamic world, everything is getting advanced almost every day. There is need of brainstorming ideas to help you. Time line server is an innovative approach to handle your needs. It was designed smartly and giving more than accurate results as it was expected to Hadoop development team.

The structure of Time line server moves around two parameters – events and entities. They are generally different for different applications. At Aegis, we are deploying timeline server as part of log management infrastructure. We have extensive experience on Hadoop platform that makes it easy for us to provide Hadoop development services in more scalable or reliable manner.

Read More Related This :
  
  • How to RM Automatic Or Manual Handling By Hadoop Developer
In this article, we will discuss how to configure or use Resource manager high availability (HA) in Hadoop. The job of Resource Manager is to track resources inside cluster and scheduling apps. In earlier version of Hadoop, Resource manager was the only point of failure where Hadoop architecture and software developer were lacking. 

Get More Information About: COF bonding training      
                                                           laptop processor chip replacement machine
SHARE

Ethan Millar

  • Image
  • Image
  • Image
  • Image
  • Image
    Blogger Comment
    Facebook Comment

0 comments:

Post a Comment