高级检索

信息论的历程:从经典到现代

The evolution of information theory: from classical to modern

  • 摘要: 文章系统梳理了信息论从经典到现代的演进历程,强调其科学内涵与全局意义。首先回顾香农创立的经典信息论,阐述其以概率论为基础的语法信息度量体系,包括信息熵、互信息、信道容量与率失真函数,以及三大编码定理。这一理论定理奠定了现代通信的理论基础。之后进一步探讨信息论与物理学(如热力学、量子力学)的深刻联系,揭示信息作为描述世界基本属性的潜力。在此基础上,介绍语义信息论的创新框架,提出“同义映射”作为沟通语法与语义的桥梁,构建语义熵、语义互信息、语义信道容量与语义率失真函数等新度量体系,并介绍三大语义编码定理,展示语义通信在扩展经典极限、实现高效“达意”传输方面的理论优势。最后展望语义信息论与人工智能、任务导向通信等前沿领域的融合,旨在推动构建智能、高效、可理解的未来信息网络。全文从科学发展的脉络出发,展现了信息论在不断深化对信息本质的理解,并持续拓展其理论边界与应用广度。

     

    Abstract: A review is presented of the evolution of information theory from its classical foundations to modern developments, with emphasis on its scientific content and global significance. We begin by reviewing Shannon’s classical information theory, elucidating its probabilistic framework for syntactic information measurement, including key concepts such as entropy, mutual information, channel capacity, and rate-distortion functions, along with the three fundamental coding theorems that underpin modern communication systems. The deep connections between information theory and physics—particularly thermodynamics and quantum mechanics—are explored, from which information is revealed as a fundamental descriptor of the physical world. Based on this, we introduce an innovative framework for semantic information theory, proposing“synonymous mapping”as a bridge between syntax and semantics. A new measurement system is constructed, featuring the entropy, mutual information, channel capacity, and rate-distortion functions of semantics. The three semantic coding theorems are demonstrated, showcasing how semantic communication can transcend classical limits to achieve more efficient meaning-oriented transmission. Finally, the paper discusses the integration of semantic information theory with cutting-edge fields such as artificial intelligence and task-oriented communications, paving the way for intelligent, efficient, and interpretable future information networks. From the trajectory of scientific development it is shown how information theory deepens our understanding of the nature of information, and also continuously expands the boundaries of theory and applications.

     

/

返回文章
返回