Most emerging applications in imaging and machine learning must perform immense amounts of computation while holding to strict limits on energy and power. To meet these goals, architects are building increasingly specialized compute engines tailored for these specific tasks. The resulting computer systems are heterogeneous, containing multiple processing cores with wildly different execution models. Unfortunately, the cost of producing this specialized hardware—and the software to control it—is astronomical. Moreover, the task of porting algorithms to these heterogeneous machines typically requires that the algorithm be partitioned across the machine and rewritten for each specific architecture, which is time consuming and prone to error.
Over the last several years, the authors have approached this problem using domain-specific languages (DSLs): high-level programming languages customized for specific domains, such as database manipulation, machine learning, or image processing. By giving up generality, these languages are able to provide high-level abstractions to the developer while producing high-performance output. The purpose of this book is to spur the adoption and the creation of domain-specific languages, especially for the task of creating hardware designs.
In the first chapter, a short historical journey explains the forces driving computer architecture today. Chapter 2 describes the various methods for producing designs for accelerators, outlining the push for more abstraction and the tools that enable designers to work at a higher conceptual level. From there, Chapter 3 provides a brief introduction to image processing algorithms and hardware design patterns for implementing them. Chapters 4 and 5 describe and compare Darkroom and Halide, two domain-specific languages created for image processing that produce high-performance designs for both FPGAs and CPUs from the same source code, enabling rapid design cycles and quick porting of algorithms. The final section describes how the DSL approach also simplifies the problem of interfacing between application code and the accelerator by generating the driver stack in addition to the accelerator configuration.
This book should serve as a useful introduction to domain-specialized computing for computer architecture students and as a primer on domain-specific languages and image processing hardware for those with more experience in the field.
Steven Bell is a Ph.D. candidate at Stanford University, where he's building camera platforms as a vehicle to explore the challenge of rapidly creating high-performance hardware/software systems. As part of his Ph.D. work, he has developed imaging algorithms, written kernel drivers, and wrangled FPGA tools. His interests include image processing and computational photography, embedded software and systems, and teaching these topics to others. He received a B.S. in computer engineering from Oklahoma Christian University in 2011.
Jing Pu received a B.S. in microelectronics from Peking University and an M.S. and Ph.D. in electrical engineering from Stanford University. He is currently working on Pixel Visual Core and Halide at Google. During his Ph.D., he worked on programming CPU/FPGA heterogeneous systems from the Halide image processing language. His research interests include domain-specific architectures and compilers, computer vision, and deep learning.
James Hegarty is a research scientist whose work looks at developing new hardware design methodologies to enable rapid hardware-software co-design of low power image processing and computer vision systems. James' recent work involved the development of the Darkroom and Rigel image processing hardware languages. Previously, James worked on graphics systems, where he helped develop a novel real-time GPU rendering system that reduced shading load by 9x on micropolygon workloads. James holds a B.S., M.S., and Ph.D. in computer science from Stanford University.
Mark Horowitz is the Yahoo! Founders Professor at Stanford University and was chair of the Electrical Engineering Department from 2008–2012. He co-founded Rambus, Inc. in 1990 and is a fellow of the IEEE and the ACM and a member of the National Academy of Engineering and the American Academy of Arts and Science. Dr. Horowitz's research interests are quite broad and span applying EE and CS analysis methods to problems in molecular biology to creating new design methodologies for analog and digital VLSI circuits.
