In this post we will see the difference between HDFS and Cloud Storage
What is cloud object storage? How it is different from HDFS 🥃
Cloud computing makes extensive use of object storage. This has many advantages, including cost, speed, and scalability. Object storage contrasts with HDFS, and should be understood as an alternative technology. Importantly, object storage is not a file system. Unlike HDFS, it does not store data in files.
Object storage cost considerations 🎰
Object storage is significantly cheaper than other alternatives, leading to massive savings for organizations. In fact, it is often the most economical way to house large amounts of data, creating a large economic incentive for businesses to make the shift to object storage.
Distributed storage and concurrency 🎰
The ability of object storage to hold vast quantities of data also makes them ideal for workloads that read large amounts of concurrent, distributed data. This mirrors the distributed storage seen with HDFS, but improves on it considerably.
Examples of cloud-based object storage 🎰
The three largest providers of cloud-based object storage technologies are:
Advantages of cloud object storage 🎰
Data lakes constructed using cloud storage technology operate differently than their HDFS-based counterparts.
Increase data footprint
Enhanced separation of compute and storage
On-premises installations