—This paper suggests a novel method to evaluate the progress of the scoliotic patients. The scoliosis is an affection that deviates in a three dimensional plan the patient’s spinal cord. Today the severity of the scoliosis is determined by the Cobb angles on the x-ray. Our method uses the Kinect sensor that can capture in a 3 dimensional plane the joints of the human body. Using the joint’s position in the 3D plane, the relative angles of key joints to a predetermined point is measured. Using these angles the system calculates the severity of the scoliosis. On the same principle we suggest a system that can monitor the patient’s exercises during the treatment. I. IDIOPATHIC SCOLIOSIS Scoliosis is a medical condition in which the spinal cord of the patient suffers from a three-dimensional deviation. Scoliosis can be classified in two major types: congenital scoliosis which is caused by several vertebral anomalies present at the birth, or idiopathic which cause is unknown. Idiopa...