Computing and Networks
Computing & Compute Systems
The complete student field guide
AI generated by Nikhil Kumar Rajput
In the reading lists AI and machine learning (book 3 of 4) and Networks and systems (book 1 of 7)
8 chapters
Contents¶
Front matter
Chapters
Chapter 1: Computing Foundations
- 1.1 What Is a Computer?
- 1.2 Types of Compute: CPU, GPU, TPU, NPU, MCU and the xPU Family
- 1.3 Specialised Compute Engines: ISPs, Media Engines, Modems, Security Processors and More
- 1.4 Binary, Hexadecimal and Units of Data
- 1.5 Whole Numbers: Integers, Two's Complement and Overflow
- 1.6 Real Numbers: Floating Point and IEEE 754
- 1.7 Text, Images and Sound as Numbers
- 1.8 Logic Gates, Boolean Algebra and Transistors
- 1.9 Circuit Building Blocks: Combinational and Sequential Logic
- 1.10 Computer Architecture Models: von Neumann vs Harvard
- 1.11 How a Program Runs: From Source Code to Machine Code
- 1.12 Measuring Performance: Clock Speed, IPC, FLOPS and Amdahl's Law
- 1.13 Moore's Law, Dennard Scaling and Process Nodes
- 1.14 Orders of Magnitude: Prefixes and Latency Numbers
- 1.15 A Short History of Computing: From Babbage to Exascale
Chapter 2: Processors & CPU Architecture
- 2.1 Inside a CPU: The Parts That Do the Work
- 2.2 Instruction Set Architectures: x86, Arm, RISC-V and Friends
- 2.3 Assembly Language and Machine-Level Programming
- 2.4 Pipelines and Hazards
- 2.5 Superscalar and Out-of-Order Execution
- 2.6 Branch Prediction and Speculative Execution
- 2.7 CPU Caches: L1, L2, L3 and How They Work
- 2.8 Cache Coherence and Memory Ordering
- 2.9 Multicore, SMT, Hybrid Cores, NUMA and Power
- 2.10 SIMD and Vector Extensions
- 2.11 SoCs, Chiplets and Advanced Packaging
- 2.12 x86 Processor Families: Intel and AMD in 2026
- 2.13 Arm, Apple and RISC-V Processor Families
- 2.14 Interrupts, Exceptions and Privilege Levels
- 2.15 Buses and I/O: PCIe, USB, Thunderbolt and Display Links
- 2.16 Hardware Security Features in CPUs
- 2.17 Side Channels, Hardware Attacks and Confidential Computing
Chapter 3: Memory & Storage
- 3.1 The Memory Hierarchy
- 3.2 SRAM, DRAM and Memory Modules
- 3.3 DRAM Generations and Standards (DDR, LPDDR, GDDR, HBM)
- 3.4 Virtual Memory, Paging and the TLB
- 3.5 CXL: Compute Express Link and Memory Pooling
- 3.6 NAND Flash and SSDs
- 3.7 Storage Interfaces and Form Factors (PCIe, NVMe, SATA, SAS)
- 3.8 Hard Disk Drives and Tape
- 3.9 RAID, Erasure Coding and Backups
- 3.10 File Systems
- 3.11 Block, File and Object Storage on the Network
- 3.12 Emerging Memory and Processing-in-Memory
Chapter 4: GPUs & AI Accelerators
- 4.1 Why Accelerators? CPUs vs GPUs and Specialised Chips
- 4.2 Inside a GPU: SMs, Warps, Tensor Cores and Memory
- 4.3 NVIDIA GPUs: From V100 to Blackwell, Rubin and GeForce RTX 50
- 4.4 AMD Instinct and Radeon GPUs
- 4.5 Intel GPUs and Gaudi AI Accelerators
- 4.6 Programming GPUs: CUDA, ROCm, SYCL, Triton and Friends
- 4.7 Graphics: The Rendering Pipeline, Ray Tracing and Displays
- 4.8 Cloud Giants' Own AI Chips: TPU, Trainium, Maia and MTIA
- 4.9 AI Chip Start-ups and Wafer-Scale Engines
- 4.10 NPUs in PCs and Phones
- 4.11 FPGAs and Custom ASICs
- 4.12 How a Chip Is Designed: From RTL to Tape-Out
- 4.13 Number Formats for AI: FP64 to FP4 and Quantisation
- 4.14 AI Training vs Inference: Compute and Memory Maths
- 4.15 Connecting Accelerators: Scale-Up and Scale-Out
Chapter 5: Operating Systems, Firmware & Virtualization
- 5.1 What an Operating System Does
- 5.2 Processes, Threads & Concurrency
- 5.3 CPU Scheduling
- 5.4 How the OS Manages Memory
- 5.5 System Calls, Kernel Mode & Interrupts
- 5.6 Compilers, Linkers and Language Runtimes
- 5.7 The Operating Systems Landscape in 2026
- 5.8 Real-Time & Embedded Operating Systems
- 5.9 Firmware, BIOS/UEFI & the Boot Process
- 5.10 Device Drivers & I/O
- 5.11 Hypervisors & Virtual Machines
- 5.12 Containers & Kubernetes
- 5.13 WebAssembly & Other Sandboxes
- 5.14 Command-Line Tools for Inspecting a System
Chapter 6: Parallel, HPC & Distributed Computing
- 6.1 Why Parallel Computing? Speed-up, Scaling & Kinds of Parallelism
- 6.2 Flynn's Taxonomy: SISD, SIMD, MIMD, SPMD & SIMT
- 6.3 Shared vs Distributed Memory, Races & Synchronisation
- 6.4 Parallel Programming Models: OpenMP, MPI, GPU Offload & Friends
- 6.5 Anatomy of an HPC Cluster
- 6.6 Job Schedulers & Resource Managers (Slurm and Others)
- 6.7 Supercomputers & the TOP500 List
- 6.8 Interconnects & Network Topologies
- 6.9 Network Adapters from the Compute Side: NICs, Offloads, SmartNICs and DPUs
- 6.10 Distributed Systems Fundamentals: CAP, Consistency, Replication & Sharding
- 6.11 Time, Consensus & Coordination: Clocks, Paxos, Raft
- 6.12 Big Data & Distributed Compute Frameworks
- 6.13 Distributed AI Training: Data, Tensor, Pipeline & Expert Parallelism
- 6.14 Reliability at Scale: RAS, ECC, Silent Data Corruption and Failures
- 6.15 Scientific Workloads & Getting Started in HPC
Chapter 7: Cloud, Edge, Embedded & Future Compute
- 7.1 Cloud Computing Fundamentals
- 7.2 Cloud Providers, Hyperscalers & GPU Neoclouds
- 7.3 Cloud Compute Instances: Choosing a Virtual Machine
- 7.4 Cloud Pricing Models & FinOps
- 7.5 Serverless & Managed Compute
- 7.6 Data Centres: Where the Cloud Physically Lives
- 7.7 Edge Computing
- 7.8 Embedded Systems & Microcontrollers
- 7.9 Single-Board Computers: Raspberry Pi, Jetson & Friends
- 7.10 Mobile Systems-on-Chip: The Brains of Phones
- 7.11 Quantum Computing Basics
- 7.12 Beyond Conventional Chips: Neuromorphic, In-Memory & Photonic Computing
- 7.13 Green Computing & Energy Efficiency
Chapter 8: Performance, Tools, Careers & Learning
- 8.1 Benchmarking Basics & Pitfalls
- 8.2 Benchmark Suites You Will Meet
- 8.3 Profiling & Monitoring Tools
- 8.4 Performance Analysis Methods
- 8.5 Optimisation Basics
- 8.6 Power, Thermals & TDP
- 8.7 Building or Choosing a PC
- 8.8 Choosing a Server or Workstation
- 8.9 Careers in Computing Systems
- 8.10 Certifications & Courses
- 8.11 Books & Learning Resources
- 8.12 Hands-On Projects & Lab Ideas
- 8.13 Interview Questions & Model Answers
Back matter
Ten Things Every Computing Student Should Master
- 1. Think in binary and hex
- 2. Trace a program from source to silicon
- 3. Explain the memory hierarchy
- 4. Understand how modern CPUs go fast
- 5. Know when a GPU or accelerator wins
- 6. Reason about performance
- 7. Know what the operating system does
- 8. Understand virtualisation and containers
- 9. Scale out with parallel and distributed computing
- 10. Measure, don't guess
About this book¶
A student's plain-English guide to how computers compute — from logic gates to CPUs, GPUs, AI accelerators, memory, operating systems, HPC and cloud. Every topic is explained with an everyday analogy, a worked example, step-by-step mechanics, and a table of the chips, architectures, standards, tools and vendors you need to know.