ZIGGURAT_OPENMP is a C++ library which explores how the ZIGGURAT library may be used, in conjunction with OpenMP, to compute random numbers efficiently and correctly.
The primary worry, when computing random numbers in OpenMP, occurs when the user calls a random number generator which may have some internal memory. In that case, the internal memory may become corrupted if multiple threads are invoking the code at the same time.
A safe way to compute random numbers is to ensure that the seed value, and any other data or tables needed by the computation, are stored externally, in the user program. That way, each thread can have a separate copy of the data, and multiple threads of random number calculations can be going along simultaneously without fear of overwriting or memory contention.
The program presented here is somewhat awkward, because it wishes to verify that OpenMP can compute exactly the same data as a sequential program. To do so, we need to create separate seeds for each threads, and ensure that the threads execute the loop iterations in some predictable sequence. When the sequential program goes through the same calculations, we again have to do some acrobatics to ensure that it is doing the same things that the parallel program did.
So some of the complications in this program are there to ensure that we can exhibit the same results sequentially and in parallel. Once you are convinced of that, and see how to go about this, your own program can be set up without some of the overhead and special instructions used in this demonstration.
On an Apple PowerPC G5 with two processors, the following results were observed:
| Threads | Test01 | Test02 | Test03 | Test04 |
|---|---|---|---|---|
| 1 | 0.521 s | 2.342 s | 1.175 s | 1.223 s |
| 2 | 0.226 s | 1.202 s | 0.595 s | 0.615 s |
| 4 | 0.225 s | 1.187 s | 0.592 s | 0.614 s |
In the BASH shell, the program could be run with 2 threads using the commands:
export OMP_NUM_THREADS=2
./ziggurat_openmp
The computer code and data files described and made available on this web page are distributed under the GNU LGPL license.
ZIGGURAT_OPENMP is available in a C version and a C++ version and a FORTRAN90 version.
DIJKSTRA_OPENMP, a C++ program which uses OpenMP to parallelize a simple example of Dijkstra's minimum distance algorithm for graphs.
FFT_OPENMP, a C++ program which demonstrates the computation of a Fast Fourier Transform in parallel, using OpenMP.
HEATED_PLATE_OPENMP, a C++ program which solves the steady (time independent) heat equation in a 2D rectangular region, using OpenMP to run in parallel.
HELLO_OPENMP, a C++ program which prints out "Hello, world!" using the OpenMP parallel programming environment.
JACOBI_OPENMP, a C++ program which illustrates the use of the OpenMP application program interface to parallelize a Jacobi iteration solving A*x=b.
MD_OPENMP, a C++ program which carries out a molecular dynamics simulation using OpenMP.
MULTITASK_OPENMP, a C++ program which demonstrates how to "multitask", that is, to execute several unrelated and distinct tasks simultaneously, using OpenMP for parallel execution.
MXM_OPENMP, a C++ program which computes a dense matrix product C=A*B, using OpenMP for parallel execution.
OPENMP, C++ programs which illustrate the use of the OpenMP application program interface for carrying out parallel computations in a shared memory environment.
OPENMP_RCC, C++ programs which illustrate how a C program, using OpenMP, can be compiled and run in batch mode on the FSU High Performance Computing (HPC) cluster operated by the Research Computing Center (RCC).
POISSON_OPENMP, a C++ program which computes an approximate solution to the Poisson equation in a rectangle, using the Jacobi iteration to solve the linear system, and OpenMP to carry out the Jacobi iteration in parallel.
PRIME_OPENMP, a C++ program which counts the number of primes between 1 and N, using OpenMP for parallel execution.
QUAD_OPENMP, a C++ program which approximates an integral using a quadrature rule, and carries out the computation in parallel using OpenMP.
RANDOM_OPENMP, a C++ program which illustrates how a parallel program using OpenMP can generate multiple distinct streams of random numbers.
SATISFY_OPENMP, a C++ program which demonstrates, for a particular circuit, an exhaustive search for solutions of the circuit satisfy problem, using OpenMP for parallel execution.
SCHEDULE_OPENMP, a C++ program which demonstrates the default, static, and dynamic methods of "scheduling" loop iterations in OpenMP to avoid work imbalance.
SGEFA_OPENMP, a C++ program which reimplements the SGEFA/SGESL linear algebra routines from LINPACK for use with OpenMP.
ZIGGURAT, a C++ program which generates points from a uniform, normal or exponential distribution, using the ziggurat method.
You can go up one level to the C++ source codes.