Gove, D: Multicore Application Programming

Preface xv Acknowledgments xix About the Author xxi Chapter 1: Hardware, Processes, and Threads 1 Examining the Insides of a Computer 1 The Motivation for Multicore Processors 3 The Characteristics of Multiprocessor Systems 18 The Translation of Source Code to Assembly Language 21 Summary 29 Chapter 2: Coding for Performance 31 Defining Performance 31 Understanding Algorithmic Complexity 33 How Structure Impacts Performance 39 The Role of the Compiler 60 Identifying Where Time Is Spent Using Profiling 74 How Not to Optimize 80 Performance by Design 82 Summary 83 Chapter 3: Identifying Opportunities for Parallelism 85 Using Multiple Processes to Improve System Productivity 85 Multiple Users Utilizing a Single System 87 Improving Machine Efficiency Through Consolidation 88 Using Parallelism to Improve the Performance of a Single Task 92 Parallelization Patterns 100 How Dependencies Influence the Ability Run Code in Parallel 110 Identifying Parallelization Opportunities 118 Summary 119 Chapter 4: Synchronization and Data Sharing 121 Data Races 121 Synchronization Primitives 126 Deadlocks and Livelocks 132 Communication Between Threads and Processes 133 Storing Thread-Private Data 141 Summary 142 Chapter 5: Using POSIX Threads 143 Creating Threads 143 Compiling Multithreaded Code 151 Process Termination 153 Sharing Data Between Threads 154 Variables and Memory 175 Multiprocess Programming 179 Sockets 193 Reentrant Code and Compiler Flags 197 Summary 198 Chapter 6: Windows Threading 199 Creating Native Windows Threads 199 Methods of Synchronization and Resource Sharing 208 Wide String Handling in Windows 221 Creating Processes 222 Atomic Updates of Variables 238 Allocating Thread-Local Storage 240 Setting Thread Priority 242 Summary 244 Chapter 7: Using Automatic Parallelization and OpenMP 245 Using Automatic Parallelization to Produce a Parallel Application 245 Using OpenMP to Produce a Parallel Application 256 Ensuring That Code in a Parallel Region Is Executed in

Darryl Gove is a senior principal software engineer in the Oracle Solaris Studio compiler team. He works on the analysis, parallelization, and optimization of both applications and benchmarks. Darryl has a master's degree and a doctorate in operational research from the University of Southampton, UK. He is the author of the books Solaris Application Programming (Prentice Hall, 2008) and The Developer's Edge (Sun Microsystems, 2009). He writes regularly about optimization and coding and maintains a blog at www.darrylgove.com.