This monograph presents probabilistic representations for classical boundary value problems of mathematical physics, and is devoted to the walk on boundary algorithms. Compared to the well-known Wiener and diffusion-path integrals, the trajectories of random walks in this publication are simulated on the boundary of the domain as Markov chains generated by the kernels of the boundary integral equations equivalent to the original boundary value problem.