Markov Models
Markov models are statistical tools that are useful for NLP because they can be used for part-of-speech- tagging applications.
Their first use was in modeling the letter sequences in works of Russian literature
They were later developed as a general statistical tool.
More specifically, they model a sequence (perhaps through time) of random variables that are not necessarily independent.
They rely on two assumptions: Limited Horizon and Time Invariant.