Overview of HDFSΒΆ

As part of this module we will be covering all important aspects of HDFS that are required for development. We have covered all the essentials for the development.

  • Using HDFS CLI

  • Getting Help or Usage

  • Listing HDFS Files

  • Managing HDFS Directories

  • Copying files from HDFS to Local

  • Copying files from HDFS to HDFS

  • Previewing data in HDFS Files

  • Getting File Metadata

  • HDFS Block Size

  • HDFS Replication Factor

  • Getting HDFS Storage Usage

  • Using HDFS Stat Commands

  • HDFS File Permissions

  • Overriding Properties

Exercise - Getting Started with Spark SQL Using HDFS CLI