Basics of Being a Sysadmin

Welcome to the wonderful world of systems administration! You have our sympathy, and as much aid as we can be bothered to give. Here you will find instructions on a couple of basic tasks, as well as some magic incantations to make emergencies of various kinds go away.

• Working with Deez Notes
• Structure of the Cluster
  • Control Layer
    • Magellan
    • Gomes
    • Crimea
  • Storage Layer
  • Compute Nodes
  • Virtual Hosts
    • AFS Virtual Servers
    • Openstack Service VMs
  • Chicago
  • Desktops
  • Beaglebones and RazPis
    • Typhon and Echidna
    • Janus
  • Various Others
    • Calliope
    • T2000s
    • Gacrux
    • Bigbrother
• Common Installation Steps
  • SSH
  • Debian Unattended Upgrades
  • Debian Package Pinning
  • Systemd
    • Unit Configuration Drop-In
  • Linux Serial Console
    • Debian Grub
    • Linux Init
  • Slow Root Devices
  • Host Access to AFS
• Random Simple Things that have Worked in the Past and are Likely to Work Again
  • A Sunfire Goes Down
  • The Website is Reachable, but everything 403’s or 404’s
  • Mail server fails IMAP requests
  • Echidna’s AFS servers died
  • You can’t do ceph things with cinder (like create/delete volumes)
  • Ceph won’t start on a sunfire due to permission errors
  • A ceph mon is down after a restart
  • OpenStack VMs won’t be deleted, and they just hang
  • You Can’t Delete OpenStack VMs (they’re stuck in the deleting state)
• Service Wishlist