Skip to main content
  1. /classes/
  2. Classes, Fall 2024/
  3. CS 2010 Fall 2024: Course Site/
  4. cs2010 Notes/

cs2010 Notes: 04 Computer Numbers

·61 words·1 min·

We’ve been talking about algorithms involving numbers. That presumes that computers can process numbers.

Can they?

What numbers?

How are those numbers stored?

Do the details matter?

A simple conceptual RAM stores bits.

A modern real RAM stores bytes.

Nybbles and Hex

  • Decimal <=> Binary
  • Binary <=> Hex
  • Hex <=> Decimal

1, 2, 4, 8 byte integers

Sign bits

Floating Point

Nat Tuck
Author
Nat Tuck