Sockeye - Detailed Technical Specifications

Compute

Sockeye provides access to 15,872 CPU cores and 200 GPUs.

  • 412 x Dell EMC R440 CPU compute nodes:
    • 210 x Base nodes with 32 CPU cores and 192GB RAM (6GB/core)
    • 170 x Base nodes with 40 CPU cores and 192GB RAM (4.8GB/core)
    • 8 x Medium nodes with 32 CPU cores and 384GB RAM (12GB/core)
    • 8 x Medium nodes with 40 CPU cores and 384GB RAM (9.6GB/core)
    • 8 x Large nodes with  32 CPU cores and 768GB RAM (24GB/core)
    • 8 x Large nodes with 40 CPU cores and 768GB RAM  (19.2GB/core)
    • 2TB SATA local scratch (each node)
  • 50 x Dell EMC C4140 GPU compute nodes:
    • 6 x Dell EMC C4140 GPU compute nodes, each with:
      • 24 CPU cores and 192GB RAM (8GB/core)
      • 4 x NVIDIA Tesla V100 16GB
      • 1.9TB NVMe local scratch
    • 44 x Dell EMC C4140 GPU compute nodes, each with:
      • 24 CPU cores and 192GB RAM (8GB/core)
      • 4 x NVIDIA Tesla V100 32GB
      • 1.9TB NVMe local scratch
  • 3 x Dell EMC R640 management nodes
  • 3 x Dell EMC R440 login nodes
  • 2 x Dell EMC R440 data transfer nodes

Network

  • Mellanox Infiniband EDR interconnect (100Gbps)
    • 7 x Base compute islands @ 5:1 blocking ratio
    • 1 x Mixed Medium, Large & GPU compute island @ 2:1 blocking ratio
    • 8 x Mixed compute/GPU islands @ 5:1 blocking ratio
  • Mellanox 1/10/25/40/50/100GbE Ethernet
  • 2 x 100Gbps primary/secondary redundant upstream network connectivity

Storage

  • DDN Lustre parallel filesystem with approx. 1.5PB usable capacity
  • Dell EMC Isilon distributed network attached storage with approx. 1.2PB usable capacity across two distinct performance tiers
  • Dell EMC ECS distributed object storage with up to 20PB of usable capacity before data replication

UBC Crest The official logo of the University of British Columbia. Urgent Message An exclamation mark in a speech bubble. Caret An arrowhead indicating direction. Arrow An arrow indicating direction. Arrow in Circle An arrow indicating direction. Arrow in Circle An arrow indicating direction. Chats Two speech clouds. Facebook The logo for the Facebook social media service. Information The letter 'i' in a circle. Instagram The logo for the Instagram social media service. External Link An arrow entering a square. Linkedin The logo for the LinkedIn social media service. Location Pin A map location pin. Mail An envelope. Menu Three horizontal lines indicating a menu. Minus A minus sign. Telephone An antique telephone. Plus A plus symbol indicating more or the ability to add. Search A magnifying glass. Twitter The logo for the Twitter social media service. Youtube The logo for the YouTube video sharing service.