Overview: A caching system management used in SparkSQL/Apache Spark and HDFS Requirements: SparkSQL, ApacheSpark, HDFS, Data caching algorithm and English skills. Motivation: We are now using the HDFS to store and manage the data. And we do also the data analytics using SparkSQL in Apache Spark. Normally, the Application Driver of Apache Spark will load […]