Past Course Materials
Digital Design and Computer Architecture
Past Course Materials
Digital Design and Computer Architecture
Dear CompArch Students,
We would like to invite you to the next SAFARI Live Seminar, which will take place on Monday. Please find the details below.
We would strongly recommend you to attend, since this Seminar is very much related to many of the contents of the course.
Christina Giannoula, National Technical University of Athens
Livestream at 5:30 pm Zurich time (CEST) on YouTube:
Abstract: Recent advances in 3D-stacked memories have renewed interest in Near-Data Processing (NDP). NDP architectures perform computation close to where the application data resides, and constitute a promising way to alleviate data movement costs. These architectures can provide significant performance and energy benefits to parallel applications. Typical NDP architectures support several NDP units, each including multiple simple cores placed close to memory. To fully leverage the benefits of NDP and achieve high performance for parallel workloads, efficient synchronization among the NDP cores of a system is necessary. However, supporting synchronization in many NDP systems is challenging due to three architectural characteristics: (i) most NDP architectures lack shared caches that can enable low-cost communication and synchronization among NDP cores of the system, (ii) hardware cache coherence protocols are typically not supported in NDP systems due to high area and traffic overheads, (iii) NDP systems are non-uniform, distributed architectures, in which inter-unit communication is more expensive (both in performance and energy) than intra-unit communication.
In this seminar, we comprehensively examine the synchronization problem in NDP systems, and propose SynCron, an end-to-end synchronization solution for NDP systems. SynCron is designed to achieve the goals of performance, cost, programming ease, and generality to cover a wide range of synchronization primitives through four key techniques. First, SynCron adds low-cost hardware support near memory for synchronization acceleration. Second, SynCron includes a specialized cache memory structure to avoid memory accesses for synchronization and minimize latency overheads. Third, it implements a hierarchical message-passing communication protocol to minimize expensive communication across NDP units of the system. Fourth, SynCron integrates a hardware-only overflow management scheme to avoid performance degradation when hardware resources for synchronization tracking are exceeded.
Our work is the first one to analyze synchronization primitives in NDP systems using a variety of parallel workloads, covering various contention scenarios, and evaluating various NDP configurations. We demonstrate that SynCron achieves significant performance and energy improvements both under high-contention and low-contention scenarios, while it also has low hardware area and power overheads. We conclude that SynCron is an efficient synchronization mechanism for NDP systems, and hope that this work encourages further research on the synchronization problem in heterogeneous systems, including NDP systems.
Bio: Christina Giannoula is a Ph.D. student in the School of Electrical and Computer Engineering at the National Technical University of Athens (NTUA). She is working in the Computing Systems Laboratory, and is an affiliated Ph.D. researcher in the SAFARI research group at ETH Zürich, which is led by Prof. Onur Mutlu. She received a 5-year Diploma degree (Masters equivalent) in Electrical and Computer Engineering from NTUA in 2016, being awarded with several distinctions including the ‘Paris Kanellakis’ NTUA award, and graduating in the top 2% of her class. Since 2017, she has been working toward a Ph.D. degree at NTUA, and in 2019 she was a visiting PhD researcher in the SAFARI research group at ETH Zürich advised by Prof. Onur Mutlu and mentored by Prof. Nandita Vijaykumar. Her research interests lie in the intersection of computer architecture and high-performance computing. Specifically, her research focuses on the hardware/software co-design of emerging applications, including graph processing, pointer-chasing data structures, machine learning workloads, and sparse linear algebra, with modern computing paradigms, such as large-scale multicore systems and near-data processing architectures. She has several publications and awards for her research on these topics.
Paper: Christina Giannoula, Nandita Vijaykumar, Nikela Papadopoulou, Vasileios Karakostas, Ivan Fernandez, Juan Gómez-Luna, Lois Orosa, Nectarios Koziris, Georgios Goumas, and Onur Mutlu, “SynCron: Efficient Synchronization Support for Near-Data-Processing Architectures”, Proceedings of the 27th International Symposium on High-Performance Computer Architecture (HPCA), Virtual, February-March 2021. https://people.inf.ethz.ch/omutlu/pub/SynCron-synchronization-for-near-data-processing-systems_hpca21.pdf
[Slides (https://people.inf.ethz.ch/omutlu/pub/SynCron-synchronization-for-near-data-processing-systems_hpca21-talk.pptx) (https://people.inf.ethz.ch/omutlu/pub/SynCron-synchronization-for-near-data-processing-systems_hpca21-talk.pdf)]
[Short Talk Slides (https://people.inf.ethz.ch/omutlu/pub/SynCron-synchronization-for-near-data-processing-systems_hpca21-short-talk.pptx) (https://people.inf.ethz.ch/omutlu/pub/SynCron-synchronization-for-near-data-processing-systems_hpca21-short-talk.pdf)]
[Talk Video (21 minutes) https://www.youtube.com/watch?v=2RKgFmyXzi0&list=PL5Q2soXY2Zi8_VVChACnON4sfh2bJ5IrD&index=103]
[Short Talk Video (7 minutes) https://www.youtube.com/watch?v=MPzr-QZlJFI&list=PL5Q2soXY2Zi8_VVChACnON4sfh2bJ5IrD&index=105]
Welcome to the Seminar in Computer Architecture course.
With the aim of complying with both COVID-19 safety measures and ETH's encouragement for in-class teaching, we have decided to go for a hybrid teaching mode this semester. This is the first semester during the pandemic to experience such a teaching mode and we hope it will be a pleasant and successful one.
Our first lecture will be on 23 September 2021 at 16:15-18:00 Zurich time. You have two options to attend:
1) Please use the following Zoom link to attend the lecture at your own place: (check moodle)
2) Or bring your laptop and join the zoom meeting (the same link as above) from the lecture room (HG-D-3.2) on-campus. We will have at least two TAs in-class for answering your concerns. The presenter (the student or the lecturer) can be present in-class or virtually depending on his/her choice. Please remember that you must present your COVID-19 (vaccinated, recovered, or tested) certificate to the TAs before accessing the classroom.
We also released what we call Homework #0 on https://safari.ethz.ch/architecture_seminar/fall2021/doku.php?id=homework. It is compulsory to answer all questions and submit it on time (Due: Thursday 30 September 2021, 11:59 pm Zurich).
We are very much looking forward to an exciting course and semester with you all, covering fascinating topics in Computer Architecture.
We wish you the best with all your courses this semester.
Professor Onur Mutlu, Dr. Mohammed Alser, Dr. Juan Gómez Luna