Computer Science > Information Theory
[Submitted on 22 Dec 2022]
Title:How Semantic Information G Measure Relates to Distortion, Freshness, Purposiveness, and Efficiency
View PDFAbstract:To improve communication efficiency and provide more useful information, we need to measure semantic information by combining inaccuracy or distortion, freshness, purposiveness, and efficiency. The author proposed the semantic information G measure before. This measure is more compatible with Shannon information theory than other semantic or generalized information measures and has been applied to machine learning. This paper focuses on semantic predictive information (including observation information) and purposive (or goal-related) information (involving semantic communication and constraint control). The GPS pointer is used as an example to discuss the change of semantic predictive information with inaccuracy and time (age of the information). An example of constraint control (controlling probability distributions) is provided for measuring purposive information and maximizing this information and the information efficiency. The information rate fidelity function (a generalization of the information rate distortion function) is introduced for the optimization. Two computing examples demonstrate how to measure predictive and goal-related information and optimizing information efficiency. The results accord with theoretical conclusions well. The G measure is related to deep learning; its application to machine learning is worth exploring. Communication efficiency also involves utilities or information values; semantic communication optimization combining utilities needs further research.
Current browse context:
cs.IT
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.