Video and image processing is becoming more and more interesting field of area because it has got a lot of areas of applications. Some of the important areas are Medical image processing, Surveillance systems for security, Computer vision and robotics and so on. All of the application areas mentioned involve video and image processing for their final decision. This monograph is written to select candidate hand gestures from a video for recognition and tracks the hand movement throughout a given video file. In doing so, the manuscript shows basic steps in image processing which are important specially for those who are interested to know more about image and video processing. Last but not least, as it was a thesis presented to a university, the way the report is written has a very good organization which can be followed for report writing.