Get a glimpse into YARN Architecture
A Quick Guide
Curious about how YARN manages resources in Hadoop? Join us in an exciting journey through the intricacies of YARN's architecture. Let's dive in together —>>
Introduction to YARN
YARN (Yet Another Resource Negotiator) is a resource management and job scheduling system in Apache Hadoop. It’s responsible for allocating resources to apps running on a Hadoop cluster & managing their execution.
YARN consists of multiple components such as Resource Manager, Node Manager, Containers, and Application Master, which work together to manage resources and schedule Hadoop jobs.
Hadoop YARN Architecture and Component
Check them out
1. The Resource Manager
The Resource Manager is the central authority that manages resources and schedules tasks across the cluster.
2. The Node Manager
The Node Manager is responsible for allocating tasks to data nodes, based on the hardware specifications of each node.
Containers are the basic unit of resource allocation in YARN, they run tasks and manage the resources required for them.
4. Application Master
The Application Master is responsible for coordinating with the Resource Manager and Node Manager to schedule and execute tasks.
1. Maintains compatibility with Hadoop 1.0 & does not affect map-reduce application.
2. YARN facilitates dynamic cluster utilization.
3. Also, multi-tenancy for better resource management.
Features of YARN Architecture
Want to learn more about YARN and all that it has to offer?
Unlock the full potential of YARN architecture and its benefits by clicking the link below.