The theory of adaptive control is concerned with construction of strategies so that the controlled system behaves in a desirable way, without assuming the complete knowledge of the system. This book considers the Markovian type models. It analyzes both partial observation and partial information cases.