Installation Manual of the ACA Spectrometer Modules

This document explains the installation procedures of ACA Spectrometer Modules (ASMs). Each of ASMs is a general-purpose computer with GPU cards (Nvidia Titan V) and data acquisition cards (production DRXP cards). ASMs are the core components of the ACA Spectrometer where data acquisition from the ACA Total Power Array and real calculations of auto- and cross-correlations from the Total Power (TP) array will happen. The software components that are need for the ASMs are an operating system, software library for the GPU cards, a device driver for the data acquisition cards, and C++/CUDA programs for the correlations. We will cover the installation procedures of the software components.

Installation CUDA toolkit

You might look up the most recent CUDA Installation Guide for Linux. As of writing this manual, CUDA 10.1 is the most recent version.

Pre-installation Actions

The command to check installed GPU cards and the output of the commend from one of ASM are as follows.

# lspci | grep -i nvidia
1b:00.0 VGA compatible controller: NVIDIA Corporation GV100 [TITAN V] (rev a1)
1b:00.1 Audio device: NVIDIA Corporation Device 10f2 (rev a1)
3d:00.0 VGA compatible controller: NVIDIA Corporation GV100 [TITAN V] (rev a1)
3d:00.1 Audio device: NVIDIA Corporation Device 10f2 (rev a1)
88:00.0 VGA compatible controller: NVIDIA Corporation GV100 [TITAN V] (rev a1)
88:00.1 Audio device: NVIDIA Corporation Device 10f2 (rev a1)
b2:00.0 VGA compatible controller: NVIDIA Corporation GV100 [TITAN V] (rev a1)
b2:00.1 Audio device: NVIDIA Corporation Device 10f2 (rev a1)

The command to check a supported version of Linux and some of the output of the command.

# uname -m && cat /etc/*release
x86_64
CentOS Linux release 7.6.1810 (Core) 

The commend to check the version gcc compiler and the first line of its output are as follows.

# gcc --version
gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-36)

The kernel version of the system can be found using the following command,

# uname -r
3.10.0-957.10.1.el7.x86_64

With the minimal installation of the CentOS? , the kernel headers and development packages were already installed.

The main motivation of this plan is to check whether or not the SM has enough performance and capability for the current and future specifications of the ALMA correlators and a spectrometer. JK will try to list up quite extensive test cases for the ALMA TP array, which will be eventually supported by the SM. The spectrometer team will do the test of the whole test cases listed in the following tables with a production GPU server. Meanwhile we also do the test of some observation modes with the prototype GPU server.

Prototype and Production GPU server

As of writing this wiki page (April 2018), a prototype GPU server with 4 NVIDIA Xp cards was built and has been used for the software development. We will use the prototype GPU server for the test. Later this year, we will upgrade the GPU cards with 4 NVIDA V cards. JK expects that a production GPU server will be assembled around the middle of 2019. It is likely composed of a server with PCIE4 slots and 4 or 6 next generation of NVIDA GPU cards.

Additional packages

The following packages were installed.

  • yum install pciutils for checking PCI devices
  • yum install hdparm for checking parameters of attached hard disks

-- JongsooKim - 04 Apr 2019

Edit | Attach | Watch | Print version | History: r15 < r14 < r13 < r12 < r11 | Backlinks | Raw View | More topic actions
Topic revision: r15 - 2019-04-04 - JongsooKim
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback