Oregon State University Provides Power9 GPU Resources
Published on Friday 19 October 2018
By: Chris Sullivan, assistant director for biocomputing, Oregon State University Center for Genome Research and Biocomputing
The Oregon State University Open Source Lab (OSUOSL) and Center for Genome Research and Biocomputing (CGRB) are excited to now provide access to POWER9 AC922 Newell Systems (8335-GTG).
The AC922 is the newest in the IBM set of AI-based servers used by many of the Oregon State research groups to overcome limits when processing large data sets. To ensure developers can take full advantage of these exciting new machines, we are allowing free access to several of these AC922 setups. We believe these new machines significantly change the way we can address limits in scope and remove bias in the work we currently do. The only limit we see is having access to all the great open source tools available on other platforms - providing developers with access can help overcome that problem.
The systems accessible to developers are set up with two processor sockets, offering 20-core (with 160 thread) at 3.0 GHz, four Tesla V100 with NVLink GPUs, 1TB of system memory, two 1.6TB CAPI-enabled NVMe SSD Controller and 40G network cards. These are the standard setups we look at for processing data as the high thread count on the CPU side allows us to process quickly along with the ability to do massive deep-learning and AI processing.
Using GPU’s to Classify Oceans of Data
For example, we currently take video from various locations in the ocean and process that data to identify all plankton to help manage ocean health. These AC922 machines are able to do all the video processing using FFMPEG with threading on the CPU side, generate images and then directly send the data to the GPUs with NVLink to process the images using a Convolutional Neural Network (CNN) to identify the plankton.
This is only one example where we can treat this machine as a cluster in a box and do all the work starting with video files and ending with CSV output with counts. We have found that the higher the threading the better the return when using the Power9 (as well as the Power8) processors.
Below is a list of processors we have available to test and some quick numbers showing the benefits of threading on these machines.
|EPYC 7601 32-Core 64 thread||Xeon E5-2620 8 core 16 thread||POWER9 20 core 40 thread|
|seconds||s * MHz||seconds||s * MHz||seconds||s * MHz|
|Factorize 1 process||69.0709||82885.0800||58.8655||200142.7000||71.8679||144885.6864|
|Factorize 2 process||71.9220||86306.4000||48.7508||165752.7200||52.2643||105364.8288|
|Factorize 8 process||22.2354||26682.4800||18.2673||62108.8200||15.2357||30715.1712|
|Factorize 16 process||16.4457||19734.8400||15.1000||51340.0000||11.3186||22818.2976|
|Factorize 32 process||23.9592||28751.0400||23.7475||80741.5000||11.9565||24104.3040|
|Factorize 36 process||24.2955||29154.6000||25.7965||87708.1000||11.6990||23585.1840|
Table 1: Processing time for different calculations showing the lower times for Power9 machines. The big return on this hardware is the threading and this table shows over 2 times faster times on Power9 as we increase threads. Many groups have achieved an order of 4 times greater return when running against the most current x86-based machines.
The CGRB is focused on working with processor companies that are changing the threading on CPUs and bringing GPUs into play, like IBM and the new AC922. Right now for workloads that take months to complete on x86 boxes we are working with developers to move tools to Power9 so we can take advantage of these returns. Because the value around these machines is centered on threading and AI, we invite developers to come and get free access to a few Power9 and other Power8 machines to port tools and optimize performance.
To get access, simply sign up for an account at the link below and we will get back to you.OSUOSL GPU Access: https://osuosl.org/services/powerdev/request_gpu/**
AC922 Hardware:** https://www.ibm.com/us-en/marketplace/power-systems-ac922