Optimizing GPU Memory Allocation and Movement using SYCL

Help Desk

Email: support@alcf.anl.gov

 

MyALCF Portal

Portal: my.alcf.anl.gov

Slides
ALP Graphic Nov 29

Building high-performant software applications requires coding to take maximum advantage of the target hardware platform. With the availability of hardware acceleration capabilities—in this case, provided by the latest generation GPUs from Intel—developers can optimize the performance of a software application by managing the allocation of memory for the device and controlling data movements between host and device through coding techniques.

The session advances understanding of the methods by which Intel® GPU performance can be optimized within a SYCL* application. Using the Intel® Developer Cloud with access to Intel® Data Center GPU Max series, this live virtual workshop delivers explanations and hands-on experience with SYCL programming techniques to demonstrate optimization methods.

The session covers:

  • Understanding how the use of Buffers and Unified Shared memory models affects performance.
  • Determining the best way to move memory between the host and device.
  • Examining various methods for allocating memory on host and device, while minimizing moving memory back and forth between the two.
  • Learning how to overlap date transfers effectively from the host to device.

Speaker Bio

Rakshith Krishnappa is a Developer Evangelist at Intel with over 17 years of experience in software development and Intel products. He graduated from Illinois Institute of Technology with master’s in Electrical and Computer Engineering. His focus at Intel is in High Performance Computing and oneAPI Products and Solutions.

Presenter
Rakshith Krishnappa, Intel