Parallel application development for Grids can from tools that abstract the underlying Grid middleware, hide the critical aspects of heterogeneous resources and provide utilities for parallelism. As a research on these issues, we have developed Grid Parallel Programming Interface (GridPPI), a Java library aiming at providing a framework for MPI-style development and execution of Java applications in service-oriented Grids. GridPPI primarily comprises an open architecture that is adaptive to various Grid platforms and an MPI-like parallel communication library that includes both basic and collective operations. We describe the design of GridPPI framework and its implementation on ChinaGrid Support Platform 2 (CGSP2) in detail, and present the performance evaluation.