This paper presents the design and preliminary implementation of MpPVM, a software system that supports process migration for PVM application programs in a non-dedicated heterogeneous computing environment. New concepts of migration point as well as migration point analysis and necessary data analysis are introduced. A preliminary implementation of MpPVM and its experimental results are also presented, showing the correctness and promising performance of our process migration mechanism in the scalable nondedicated heterogeneous computing environment.