NameNode internals

HDFS is a distributed File System for storing and managing large datasets. It divides large datasets into small data chunks where each data chunk is stored on different nodes that are part of the Hadoop cluster. However, HDFS hides these underlying complexities of dividing data into smaller chunks and copying that data to different nodes behind abstract file operation APIs. For HDFS users, these file operation APIs are just read/write/create/delete operations. All a HDFS user needs to know about is the Hadoop namespace and file URIs. But in reality, lots of steps are performed before those operations are completed. One of the key HDFS components in achieving all of these activities is NameNode. NameNode in Hadoop is a central component that regulates any operations on HDFS using file metadata that's stored in it. In other words, it manages HDFS file...