Parallel Algorithms Notes

• Parallel Models
• Parallel Algorithms
• Model of Computation
  • Random Access Machine (RAM)
  • Parallel Random Access Machine (PRAM)
• Interconnection Networks

Parallel and Distributed Algorithms

• ASC/MASC Model Spring 05.ppt
• MASC Spring 04.ppt
• MASC Spring 02.ppt

Parallel Computing Links

• BSP Worldwide -- Coordinating Bulk Synchronous Parallel Computation.
• Cerfacs - European Center for Research & Advanced Training in Scientific Computation
• CODE Visual Parallel Programming System -- allows users to change a sequential programs into a parallel.
• Chemnitz Cluster Computing Homepage -- Links to programming projects, calls for papers, software and documentation, and other resources.
• Cluster Computing Info Centre -- Links to cluster management systems, environments, software, documents, conferences, and teaching slides.
• Concurrent Systems -- Links to research groups, parallel tools, journals, and conferences.
• Designing and Building Parallel Programs -- by Ian Foster.
• Distributed Algorithms & Systems
• GAP - Groups, Algorithms and Programming -- Computational Algebra
.
• Parallel GAP/MPI (ParGAP/MPI), a share package for GAP
• Grid Computing Info Centre -- An initiative to establish a global grid of computing power. Links to conferences, development, and related information.
• The Grid: The Next-Gen Internet? -- Discussion of the Grid.
• History of the Development of Parallel Computing
• HOISe -- News on high performance computing from Europe. Newsletters and conference calendar.
• IEEE CS Task Force on Cluster Computing -- An international forum promoting cluster computing research and education. Publications, event calendar, news articles, and committee information.
• IEEE Distributed System Online
  • IEEE - ParaScope -- Links to supercomputing centers, high performance computing journals, vendors, conferences, and governmental agencies.
• Internet Parallel Computing Archive -- Links to information about parallel algorithms, computing environments and tools, newsgroups, and general references.
• Is Parallel Computing Dead? -- Article about the future of the parallel computing industry.
• Lawrence Livermore National Laboratory
• Livermore Computing Training
• Nan's Parallel Computing Page -- Links to online books, tutorials, and research projects.
• Links to Parallel Computing Resources at Indiana U.
• Open Directory - Computers, Parallel Computing, Programming etc
• ParaGraph -- a graphical display system for visualizing the behavior and performance of parallel programs on message-passing parallel computers.
• ParaGraph: A Performance Visualization Tool for MPI
• Parallel Crunchers -- News about cluster computing.
• Parallel Systems Resources
• Parallel Tools Library
• ParaScope -- Links to supercomputing centers, high performance computing journals, vendors, conferences, and governmental agencies.
• Reading List on Parallel Programming Languages -- at Case Western U.
• Scandal Project Homepage at Carnegie Mellon U.
• A Library of Parallel Algorithms
• UK E-science Grid -- Information about a government project to develop a supercomputing grid.
• Vas's Parallel Computer Taxonomy -- Discussions of past classification systems and development of a new one.
• Who Wrote the Book of Life? -- NASA uses a parallel computer to classify new life forms.

Parallel Computing Bibliographies and Journals

• Bibliographies on Parallel Processing
• IEEE Transactions on Parallel and Distributed Systems -- Monthly peer-reviewed journal. Archives available to subscribers.

Parallel Computing Groups

• Experimental Computing Lab -- at the University of Cincinnati.
• Laboratory for Parallel and Distributed Computing -- at University of Maryland.
• MIT LCS Parallel & Distributed Operating System Group
• Parallel and Associative Computing Lab at Kent State U.
• Parallel Computing at Carnegie Mellon U.
• Parallel Processing at IEEE -- A list of institutions involved in high-performance computing and parallel computing.
• PARASOL Algorithms Group at Texas A&M U. -- with online research papers.
• Stanford University Distributed Systems Group - DSG
• Supercomputing & Parallel Computing Research Groups -- Academic research groups and projects related to parallel computing.

Online Books & Tutorials

• Introduction to Effective Parallel Computing by Quentin F. Stout, Marilynn Livingston & Christiane Jablonowski -- Tutorial & notes over viewing parallel computing and how to develop efficient parallel programs. The tutorial and notes are continually being updated.
• Designing and Building Parallel Programs by Ian Foster
• Parallel Computing Works by Geoffrey C. Fox, Roy D. Williams, and Paul C. Messina -- This book describes work done at the Caltech Concurrent Computation Program, Pasadena, California. This project ended in 1990 but the work has been updated in key areas until early 1994. The book also contains links to some current projects.
• Tutorials at Maui High Performance Computing Center
• Introduction to Parallel Programming
• Parallel Code Development
• Parallel I/O Topics: MPI-IO and GPFS
• Parallel Math Libraries
• Parallel Operating Environment (POE P2SC)
• Parallel Operating Environment (POE P3)
• Parallel Programming Introduction

Parallel Computing and Java

• An Introduction to Parallel Computing with Java
• mpiJava -- The HP Java Project.
• ProActive PDC -- The Java library for Parallel, Distributed, Concurrent computing with Security & Mobility

MPI (Message Passing Interface)

Related Links

• LAM/MPI Parallel Computing
• EPCC Training and Education Documents -- contains notes on "Writing Message-Passing Parallel Programs with MPI", Edinburgh Parallel Computing Center, U. of Edinburgh.
• MPI page at Argonne National laboratory
• Open Directory - Computers, Parallel Computing, Programming, Libraries, MPI
• User's Guide for mpich, a Portable Implementation of MPI -- Harvey Mudd College
• What is MPI? -- provides a number of references useful for getting started with MPI.

Implementation of MPI

• MIPICH-- A Portable Implementation of MPI
  • mpich implementation -- developed at Argonne National Lab & Mississippi State University (download)
• LAM / MPI Parallel Computing Downloads -- the LAM implementation developed at the Ohio supercomputer Centre (download)
• CHIMP implementation -- developed at the Edinburgh Parallel Computing Centre (download)
• WinMPI implementation -- for Windows 3.1
• Implementation of MPI on the Fujitsu AP1000, AP1000+ and AP3000

The MPI FAQ, Mailing Lists, Forum etc.

• Message Passing Interface Forum
• Message Passing Interface (MPI) FAQ -- Mississippi State U.

Parallel Programming with MPI & Standards

• Parallel Programming with MPI -- by Peter Pacheco. An elementary introduction to programming parallel systems that use the MPI 1.1 library of extensions to C and Fortran.
• Message Passing Interface (MPI) standard
• MPI standard, The
  • Web Pages for MPI & MPE (MPI man pages)
• MPI, The Complete Reference -- on-line book.

Associative Computing

• ASsociative Computing (ASC) Research Group by Dr. Potter
  • Associative Computing Environment (ACE) -- which allows complex problems to be programmed in "Anglish" (Associative English).
  • Computational Problem Solving Index Page
• An Associative Computing (Stephen Scott's Papers)
• MASC: An Associative-Computing Paradigm
• Model of Computation for Associative Computing, Major Academic Research Projects, CS, KSU.
• References (Associative Computing, SIMD, MIMD Architectures etc.)