In 1948, the founder of information theory, Claude Shannon, proposed modelling language in terms of the probability of the next word in a sentence given the previous words. These types of probabilistic language models were largely derided, most famously by linguist Noam Chomsky: “The notion of ‘probability of a sentence’ is an entirely useless one.”
In 2022, 74 years after Shannon’s proposal, ref=”dofollow” data-ga-onclick=”Inarticle articleshow link click#Tech#href” href=”https://economictimes.indiatimes.com/topic/chatgpt” target=”_blank”>ChatGPT appeared, which caught the attention of the public, with some even suggesting it was a gateway to super-human intelligence. Going from Shannon’s…
