Surveys the deep neural models; connects the recently resurgent chit-chat systems and task-oriented system; introduces solutions to challenges from different perspectives; and presents data resources and evaluation methods for building retrieval-based and generation-based chit-chat systems.