Micropolis Data Storage Primer: Micropolis Handbooks

By Micropolis Handbooks

Computer data storage is a diverse field, complex and constantly changing - and yet of utmost relevance in everyday IT. Getting started with the subject can be difficult: terms are unknown, concepts are only vaguely familiar, or technical abbreviations are difficult to decipher. What is NAS, what a SAN? Is there a difference between iSCSI and Fibre Channel? What is a file-system and how does it relate to Block Storage or Hybrid cloud storage?

 

This Micropolis Handbooks publication is mainly written in the form of a technical terms glossary, meant as a quick-start guide on computer data storage. Short paragraphs per term summarize often complex matter to provide you with an overview of the field. Selected terms receive broader discussion in short articles. Several concepts are visualized in black and white illustrations. Organized like an encyclopedia, this basic reference book is a first primer on a fascinating and highly relevant topic of System Administration and Information Technology.

• Language: English
• Publisher: Micropolis Press
• Release date: Jan 19, 2024
• ISBN: 9798224020287

Book preview

Micropolis

Data Storage Primer

Micropolis Handbooks

Micropolis Press

Micropolis Data Storage Primer

from the Micropolis Handbooks series

First edition. Copyright © 2024 Micropolis

All rights reserved. No part of this book may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, scanning, recording or by any information storage and retrieval system now known or hereafter invented, without permission in writing from the publisher. Inquiries should be addressed to:

Micropolis

www.micropolis.com

[e-mail]

Published in the United States of America

Cover illustration and illustrations copyright © 2024 Micropolis

Book design, production and editing: Clipland GmbH

[e-mail]

BISAC book classifications:

COM052000 COMPUTERS / Reference

COM030000 COMPUTERS / System Admin. / Storage & Retrieval

COM032000 COMPUTERS / Information Technology

Micropolis® is a registered trademark.

Micropolis Press™ and Micropolis Handbook™

Disclaimer

The information contained within this book is for educational and entertainment purposes only. Although every precaution has been taken in the preparation of this book, the author and the publisher (we, us, Micropolis) assume no responsibility for errors or omissions. No warranties of any kind are expressed or implied. The reader agrees that we, under no circumstances, are responsible for any losses, direct or indirect, which are incurred as a result of the use of information contained within this text. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. Readers acknowledge that we are not engaging in the rendering of legal, financial, medical, technical or professional advice. For more information, the author and publisher may be contacted at the previously stated address.

MICROPOLIS PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some jurisdictions do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.

Statements regarding Micropolis' future direction or intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Trademarks

Many of the designations used by manufacturers and sellers to distinguish their products or services are claimed as trademarks. Where those designations appear in this text and Micropolis and/or the authors were aware of a trademark claim, the designations are mentioned along with their owners and may be additionally marked with a trademark symbol. Their use here within this text is for educational use of the reader and is covered under nominative fair use. Micropolis is in no way suggesting support, sponsorship or endorsement of the owner of these trademarks. Only as much of such marks is used as is necessary to identify the trademark owner, product, or service.

Links

This publication provides links to external content as a convenience and for informational purposes only; they do not constitute an endorsement, support, sponsorship or an approval by us. We bear no responsibility for the accuracy, legality or content of the external site or for that of subsequent links.

Comments welcome

We want our Micropolis Handbooks series of publications to be as helpful as possible. If you encounter errors, omissions or would like to share your comments about this book with us, feel free to contact Micropolis via email or the form found at:

https://www.micropolis.com/contact

Micropolis Data Storage Primer

Table of Contents

Intro

19-inch rack

4K video

5.25-Inch Floppy Disk

AES-256-CCM

AHCI

Allocate-on-flush

ACID properties

Adler-32

Air Gapping

Active Directory (short AD)

AFP (Apple Filing Protocol)

ARIES

Auto-Tiering

ATA over Ethernet

Authentication

Bandwidth

BeeGFS

Bin Locking (in Video Editing Systems)

Bit rot

Block cipher

Block Level

Block Storage

Btrfs

Checksumming

checksum algorithm

Ceph (distributed parallel file system)

CIFS

Cloud Storage

Cloning

Cluster

Clustered file system

Cold Storage

Coercivity

Common Redundant Power Supply (CRPS)

Content-addressable Storage

Copy on Write

Converged Ethernet

CSP (Cloud Service Provider)

Cyclic Redundancy Check (CRC)

Cylinder-Head-Sector

Data Corruption

Data Lake

Data Lakehouse

Deduplication

DMZ

Distributed file system

Drive bay form-factors

eCryptfs

Edge Computing

EncFS

Edit while Capture

EtherDrive

Ethernet

Erasure Coding

Error correction code (ECC)

eSATA

ESDI

ETL Process

exFAT

EXR (Extended Dynamic Range)

Extent

Extended file attributes

FAT

Fibre channel (FC)

Fibre Channel over IP (FCIP)

Fibre Channel over Ethernet (FCoE)

File Level storage (vs. block level storage)

File System

File Storage

Fileserver

Flash file system

Floppy disk

FTP

File virtualization

Filesystem in Userspace (FUSE)

GIO

Global file systems

Gopher

GPFS

Grid file systems

GVfs

GSS (GPFS Storage Server)

Hadoop (HDFS)

Half-rack format

HAMR drive

HBA (Host Bus Adapter)

HDD

Hierarchical file system

High availability (HA)

Hot plug

hybrid cloud

HyperSCSI

Interconnection models

IPMI

ISV Certified

IOPS

iSCSI

IMF (Interoperable Master Format)

iWARP

JBOD (Just a Bunch Of Disks)

Journaling file system

LAN (Local Area Network)

Latency

LDAP

Local Block Storage

Log-structured file system

LTFS (Linear Tape File System)

LTO

Lustre

LUKS

M.2 (NGFF)

Massive array of idle drives (MAID)

MAM (Media Asset Management)

MAMR

Managed Service Provider (MSP)

What is a Media Defect Table?

Metadata

Metadata controller

MFM Drive Interface

Mirror

mSATA (Mini-SATA)

NAND flash memory

NAS

Nearline storage

Network Switch

NFS

NLE (non-linear editing system)

NTFS

NVM Express (NVMe)

NVM Express over Fabrics (NVMe-oF)

Object Storage

OpenBMC

Open Compute Project (OCP)

OpenZFS

Oracle ZFS

Over provisioning

Penta-Level Cell (PLC)

Platter

Pool

Power-Up In Standby (PUIS)

Project Sharing

Proxy File

POSIX

POSIX compliance

What are Professional Services in Storage?

Quotas

RAID

RAID Levels

Raidion

RaptorQ code

Rebuilding

Redundancy

Remote Direct Memory Access (RDMA)

Replication

RoCE (RDMA over Converged Ethernet)

Router

Rotational media

SAN

SAS

SATA

SATA Express (SATAe)

Scale-Out

Scale-Up

Scatter/Gather

SCSI

Self-certifying file system

Self-healing

Semantic file system (SFS)

Serial Storage Architecture (SSA)

Shugart Interface

SLOG

Shingled Magnetic Recording (SMR)

SMB

Snapshot

Software-Defined Storage (SDS)

SPDK (Storage Performance Development Kit)

SSD

SSD Hot-zone

Staggered Spin-Up (SSU)

StorNext File System (SNFS)

Striping

StripeGroup

Storage Appliance

sync write

Read/Write-Head

Redfish (Redfish Scalable Platforms Management API)

What does SDS mean in a storage context?

Sneakernet

Software-defined Object Storage

Storage Virtualization

Tape Library

TCO (total cost of ownership)

Transactional file-system

U.2

U.3

Virtual file system (VFS)

WebDAV

What are White Glove Services?

Winchester Drive

xattr

XFS

Zero-Copy

Zettabyte Era

ZFS

More to read on Computer Data Storage

About Micropolis

Title Page

Table of Contents

Introduction

Data Storage 19 inch Racks

This text, mainly written in the form of a technical terms glossary, is meant as quick-start guide on computer data storage. Short paragraphs per term summarize, often complex, matter to provide you with an overview of the field, a first primer on this fascinating topic.

19-inch rack

A standardized frame or enclosure of 19 width for mounting multiple electronic equipment modules stacked over another on two parallel vertical rails. The front plate of one module measures 19 inches (482.60mm) wide, thus the name. The width of the front plate is 19 in total, including the screw terminal area, with 17.75 (450.85mm) clear area in-between vertical screwing rails (called rack opening"). One height