Format:
1 Online-Ressource (1 PDF (xxiii, 166 pages))
,
illustrations (some color)
Edition:
Also available in print
ISBN:
9781681739762
Series Statement:
Synthesis lectures on computer architecture #54
Content:
Foreword / by David Kuck -- 1 Introduction -- 1.1. Overview of the book -- 1.2. Relation between hardware, programming notations, and applications
Content:
2. Parallel hardware -- 2.1. Parallel processing before 1980 -- 2.2. Clock speed and growth in scale of integration -- 2.3. Vector supercomputers -- 2.4. Innovative start-ups -- 2.5. Clusters of microprocessors and commodity parallelism -- 2.6. Summary of parallel hardware
Content:
3. Programming notations and compilers -- 3.1. Array notation -- 3.2. Automatic parallelization for conventional languages -- 3.3. SPMD programming -- 3.4. Message passing primitives -- 3.5. Shared memory primitives -- 3.6. Dataflow -- 3.7. Parallel computing libraries -- 3.8. Parallel programming notations and machine classes
Content:
4. Applications -- 4.1. Seismic data processing -- 4.2. Finite element analysis -- 4.3. Computer-generated imagery -- 4.4. Bioinformatics -- 4.5. Computational chemistry -- 4.6. Computer vision -- 4.7. Automatic speech recognition -- 4.8. Application summary
Content:
5. Parallel hardware today and tomorrow -- 5.1. Supercomputer companies vs. Commodity companies -- 5.2. Hardware innovation-deep neural net processors -- 5.3. Cluster lessons-leading to an exaflop -- 5.4. Commodity microprocessors still evolving -- 5.5. GPUs-vector architectures unlike pipelined supercomputers -- 5.6. Beyond Moore-ICs, MCMs, and SoCs -- 5.7. Near term-system and software scaling
Content:
6. Concluding remarks -- 6.1. A hardware perspective -- 6.2. A programming notation perspective -- 6.3. An application perspective -- 6.4. Conclusion -- Appendix A. Myths and misconceptions about parallelism -- Appendix B. Bibliographic note. -- Appendix C. Taxonomic notes -- Appendix D. The 1981 tutorial.
Content:
This historical survey of parallel processing from 1980 to 2020 is a follow-up to the authors' 1981 Tutorial on Parallel Processing, which covered the state of the art in hardware, programming languages, and applications. Here, we cover the evolution of the field since 1980 in: parallel computers, ranging from the Cyber 205 to clusters now approaching an exaflop, to multicore microprocessors, and Graphic Processing Units (GPUs) in commodity personal devices; parallel programming notations such as OpenMP, MPI message passing, and CUDA streaming notation; and seven parallel applications, such as finite element analysis and computer vision. Some things that looked like they would be major trends in 1981, such as big Single Instruction Multiple Data arrays disappeared for some time but have been revived recently in deep neural network processors. There are now major trends that did not exist in 1980, such as GPUs, distributed memory machines, and parallel processing in nearly every commodity device. This book is intended for those that already have some knowledge of parallel processing today and want to learn about the history of the three areas. In parallel hardware, every major parallel architecture type from 1980 has scaled-up in performance and scaled-out into commodity microprocessors and GPUs, so that every personal and embedded device is a parallel processor. There has been a confluence of parallel architecture types into hybrid parallel systems. Much of the impetus for change has been Moore's Law, but as clock speed increases have stopped and feature size decreases have slowed down, there has been increased demand on parallel processing to continue performance gains. In programming notations and compilers, we observe that the roots of today's programming notations existed before 1980. And that, through a great deal of research, the most widely used programming notations today, although the result of much broadening of these roots, remain close to target system architectures allowing the programmer to almost explicitly use the target's parallelism to the best of their ability. The parallel versions of applications directly or indirectly impact nearly everyone, computer expert or not, and parallelism has brought about major breakthroughs in numerous application areas. Seven parallel applications are studied in this book
Note:
Part of: Synthesis digital library of engineering and computer science
,
Includes bibliographical references (pages [139]-164)
,
Compendex
,
INSPEC
,
Google scholar
,
Google book search
,
Also available in print.
,
Mode of access: World Wide Web.
,
System requirements: Adobe Acrobat Reader.
Additional Edition:
ISBN 9781681739779
Additional Edition:
ISBN 9781681739755
Additional Edition:
Erscheint auch als Druck-Ausgabe ISBN 9781681739779
Additional Edition:
ISBN 9781681739755
Language:
English
Keywords:
Electronic books
Bookmarklink
