{"id":1006,"date":"2017-09-20T23:33:22","date_gmt":"2017-09-20T20:33:22","guid":{"rendered":"https:\/\/community.virtono.com\/?p=1006"},"modified":"2017-09-20T23:49:13","modified_gmt":"2017-09-20T20:49:13","slug":"what-is-object-storage-and-why-do-you-need-it","status":"publish","type":"post","link":"https:\/\/www.virtono.com\/community\/knowledgebase\/what-is-object-storage-and-why-do-you-need-it\/","title":{"rendered":"What is Object Storage and Why do you need it"},"content":{"rendered":"<p>By this time we are familiar with the tremendous amount of data that is being produced\u00a0at a massive scale every single day by every single &#8220;smart&#8221; device around us.<\/p>\n<p>Before going any further let us differentiate between structured and unstructured data and why structured data storage techniques are now obsolete.<\/p>\n<p><strong>Structured Data<\/strong>: This type of data works after creating a pretty cut and dry model for the information that will be stored in the database, having sturdy pre-defined procedures as to how they will be stored, accessed and processed. For ex.- What fields the will be stored in? The data types (numeric, symbolic, alphabetic), What relation these different fields will have with each other, the capacity of each field and so on.<\/p>\n<p><strong>Unstructured Data<\/strong>: This type of data can be defined as the one where we cannot apply simple\u00a0logic and retrieve and create information out of. For ex.- Your photos, how will you search a photo in a database where there was a yellow backdrop and you were smiling with your wife? You can&#8217;t, Can you? However, when dealing with structured data you can find a person&#8217;s name, age, and other information that is stored smoothly.<\/p>\n<p>&nbsp;<\/p>\n<p>Okay, so we&#8217;ve got the definitions out of the way.<\/p>\n<p>Another point that I will touch on is why the techniques and usage of structured data is now obsolete.<\/p>\n<p>To work with\u00a0Structured Data we prominently use language\u00a0like SQL (Structured\u00a0Query Language). If you&#8217;ve had any previous experience with SQL you&#8217;ll know that isn&#8217;t\u00a0very efficient in handling any dynamic changes, in layman&#8217;s term you have fields with pre-defined rules, you follow those rules and you fill those fields and that is stored in the database.<\/p>\n<p>But look around now, all that data you just created reading this post, did you fill any field? Are you thinking How did I create any data, well you did create history while reading it, unless you are using the incognito mode in that case you still created history, just not that shows up in your browser.<\/p>\n<p>What about when you uploaded a picture on Instagram, that&#8217;s data.<\/p>\n<p>So how do we handle this data, that is so different from what it used to be.<\/p>\n<p>When we are producing trillions of gigabytes of this\u00a0Unstructured Data.<\/p>\n<p>Firstly, we have to evolve our old practices to be able to properly manage this high increased production of data.<\/p>\n<p>Secondly, we have to come up with new ways to store and access and work on this data to extract information.<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_73 counter-hierarchy ez-toc-counter ez-toc-light-blue ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.virtono.com\/community\/knowledgebase\/what-is-object-storage-and-why-do-you-need-it\/#What_is_Object_Storage\" title=\"What is Object Storage?\">What is Object Storage?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.virtono.com\/community\/knowledgebase\/what-is-object-storage-and-why-do-you-need-it\/#Why_Object_Storage\" title=\"Why\u00a0Object Storage?\">Why\u00a0Object Storage?<\/a><\/li><\/ul><\/nav><\/div>\n<h3><span class=\"ez-toc-section\" id=\"What_is_Object_Storage\"><\/span>What is Object Storage?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Think of storing files in a pool: no folders, directories or hierarchies. Theis is how objects are stored in a flat structure. All that is required to store an Object is its Object ID. Since they are stored in a flat manner, their retrieval is the same, i.e, through their Object IDs.<\/p>\n<p>The other important term that you need to know is metadata. So basically what metadata is data about data, so in this case data about the object is what we will be referring to as metadata.<\/p>\n<p>An Object&#8217;s metadata is arbitrary, which means that we can any information stored in the metadata of the Object. It is not limited to what our storage system thinks has merit. You can assign the type of information to be attached with an Object&#8217;s metadata, the level of protection you want to assign to the\u00a0Object, whether you want to replicate this\u00a0Object to create a backup or send over to other servers.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Why_Object_Storage\"><\/span>Why\u00a0Object Storage?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>As you&#8217;ve read and understood that there is a lot of unstructured data that is being generated, and it needs to be utilised properly, and for that, we need a solution.<\/p>\n<p>Why do we need a new solution and Why can&#8217;t the old ways work?<\/p>\n<p>Because of the rapidity this unstructured data is generated in, the quantity, and the difference of the data.<\/p>\n<p>File systems storage methods are unable to work on this.<\/p>\n<p>We need to store this rapidly generated data and storing isn&#8217;t enough we need to extract useful information from this data.<\/p>\n<p>So this is where the concept of Object Storage comes in. Because it can work on file streams in real time and is able to handle and manipulate and store data even when an overwhelming amount of data is fed to it.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>By this time we are familiar with the tremendous amount of data that is being produced\u00a0at a massive scale every single day by every single &#8220;smart&#8221; device around us. Before going any further let us differentiate between structured and unstructured data and why structured data storage techniques are now obsolete.<\/p>\n","protected":false},"author":3,"featured_media":1007,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[5],"tags":[],"class_list":["post-1006","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-knowledgebase"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2017\/09\/i_ObjectStorage_1.png?fit=400%2C250&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7ISfL-ge","jetpack_likes_enabled":true,"jetpack-related-posts":[{"id":3767,"url":"https:\/\/www.virtono.com\/community\/tutorial-how-to\/how-to-deploy-minio-on-kubernetes\/","url_meta":{"origin":1006,"position":0},"title":"How to Deploy MinIO on Kubernetes","author":"George B.","date":"August 23, 2023","format":false,"excerpt":"We will examine how to deploy MinIO on Kubernetes in this article. We're assuming that K3S and Helm are already set up on your VM. Let's get going! In the digital world, data is the new oil. Having effective and scalable storage solutions is essential as data volume increases exponentially.\u2026","rel":"","context":"In &quot;Tutorials&quot;","block_context":{"text":"Tutorials","link":"https:\/\/www.virtono.com\/community\/category\/tutorial-how-to\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2023\/08\/How-to-Deploy-MinIO-on-Kubernetes.png?fit=360%2C240&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":1826,"url":"https:\/\/www.virtono.com\/community\/knowledgebase\/what-you-absolutely-must-know-about-hash-functions\/","url_meta":{"origin":1006,"position":1},"title":"What you absolutely must know about Hash Functions","author":"Shreyash Sharma","date":"August 6, 2020","format":false,"excerpt":"How or Why are your passwords stored using Hash, ever wondered? I believe having a working knowledge of cryptographic hash functions is a must to everyone. Even though they are primarily used by security practitioners. You must hear the words often or even use them without realizing it. I will\u2026","rel":"","context":"In &quot;Knowledgebase&quot;","block_context":{"text":"Knowledgebase","link":"https:\/\/www.virtono.com\/community\/category\/knowledgebase\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2020\/08\/645055-637286229929045712-16x9-1.jpg?fit=1200%2C675&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2020\/08\/645055-637286229929045712-16x9-1.jpg?fit=1200%2C675&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2020\/08\/645055-637286229929045712-16x9-1.jpg?fit=1200%2C675&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2020\/08\/645055-637286229929045712-16x9-1.jpg?fit=1200%2C675&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2020\/08\/645055-637286229929045712-16x9-1.jpg?fit=1200%2C675&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":753,"url":"https:\/\/www.virtono.com\/community\/knowledgebase\/data-visualization-techniques\/","url_meta":{"origin":1006,"position":2},"title":"Data Visualization Techniques","author":"Daniel Draga","date":"November 13, 2016","format":false,"excerpt":"A picture is worth a thousand words \u2013 especially when you are trying to understand and gain insights from data. It is particularly relevant when you are trying to find relationships among thousands or even millions of variables and determine their relative importance. Organizations of all types and sizes generate\u2026","rel":"","context":"In &quot;Knowledgebase&quot;","block_context":{"text":"Knowledgebase","link":"https:\/\/www.virtono.com\/community\/category\/knowledgebase\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/11\/90charts.png.pagespeed.ce_.CVtP6o56PP.png?fit=381%2C345&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]},{"id":267,"url":"https:\/\/www.virtono.com\/community\/knowledgebase\/types-of-servers\/","url_meta":{"origin":1006,"position":3},"title":"Types Of Servers","author":"Daniel Draga","date":"July 30, 2016","format":false,"excerpt":"File Servers A file server may be dedicated or non-dedicated. \u00a0A dedicated server is designed specifically for use as a file server\u00a0 not for other database purposes. File servers may also be categorized by the method of access: Internet file servers are frequently accessed by File Transfer Protocol (FTP) or\u2026","rel":"","context":"In &quot;Knowledgebase&quot;","block_context":{"text":"Knowledgebase","link":"https:\/\/www.virtono.com\/community\/category\/knowledgebase\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/07\/ic-3.jpg?fit=940%2C500&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/07\/ic-3.jpg?fit=940%2C500&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/07\/ic-3.jpg?fit=940%2C500&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/07\/ic-3.jpg?fit=940%2C500&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":676,"url":"https:\/\/www.virtono.com\/community\/knowledgebase\/data-security-in-cloud-computing\/","url_meta":{"origin":1006,"position":4},"title":"Data Security in Cloud Computing","author":"Daniel Draga","date":"October 3, 2016","format":false,"excerpt":"\u0097With the development of cloud computing, Data security becomes more and more important in cloud computing. This paper analyses the basic problem of cloud computing data security. . \u0097Cloud Computing provides the way to share distributed resources and services that belong to different organizations or sites. Since Cloud Computing share\u2026","rel":"","context":"In &quot;Knowledgebase&quot;","block_context":{"text":"Knowledgebase","link":"https:\/\/www.virtono.com\/community\/category\/knowledgebase\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/07\/IMG_2035.jpg?fit=1200%2C900&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/07\/IMG_2035.jpg?fit=1200%2C900&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/07\/IMG_2035.jpg?fit=1200%2C900&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/07\/IMG_2035.jpg?fit=1200%2C900&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/07\/IMG_2035.jpg?fit=1200%2C900&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":287,"url":"https:\/\/www.virtono.com\/community\/knowledgebase\/mysql-top-10-design-tips\/","url_meta":{"origin":1006,"position":5},"title":"MySQL: Top 10 Design Tips","author":"Daniel Draga","date":"August 7, 2016","format":false,"excerpt":"This article is a fraction of a Number of Articles on MySQL, to access them click here. \u00a0\u00a0\u00a0\u00a0\u00a0 1.Understand Your Technology Tools MySQL is great platform to manage your database, and to be able to understand every aspect is not that easy, but the one thing that we can do\u2026","rel":"","context":"In &quot;Knowledgebase&quot;","block_context":{"text":"Knowledgebase","link":"https:\/\/www.virtono.com\/community\/category\/knowledgebase\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/08\/MySQL_Replication1-2.png?fit=965%2C687&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/08\/MySQL_Replication1-2.png?fit=965%2C687&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/08\/MySQL_Replication1-2.png?fit=965%2C687&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.virtono.com\/community\/wp-content\/uploads\/2016\/08\/MySQL_Replication1-2.png?fit=965%2C687&ssl=1&resize=700%2C400 2x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/posts\/1006","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/comments?post=1006"}],"version-history":[{"count":3,"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/posts\/1006\/revisions"}],"predecessor-version":[{"id":1012,"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/posts\/1006\/revisions\/1012"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/media\/1007"}],"wp:attachment":[{"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/media?parent=1006"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/categories?post=1006"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.virtono.com\/community\/wp-json\/wp\/v2\/tags?post=1006"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}