Skip to main content
Log in

Information granules and entropy theory in information systems

  • Published:
Science in China Series F: Information Sciences Aims and scope Submit manuscript

Abstract

Information granulation and entropy theory are two main approaches to research uncertainty of an information system, which have been widely applied in many practical issues. In this paper, the characterizations and representations of information granules under various binary relations are investigated in information systems, an axiom definition of information granulation is presented, and some existing definitions of information granulation become its special forms. Entropy theory in information systems is further developed and the granulation monotonicity of each of them is proved. Moreover, the complement relationship between information granulation and entropy is established. This investigation unifies the results of measures for uncertainties in complete information systems and incomplete information systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Zadeh L A. Fuzzy logic=computing with words. IEEE Trans Fuzzy Syst, 1996, 4(1): 103–111

    Article  MathSciNet  Google Scholar 

  2. Zadeh L A. Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst, 1997, 19(1): 111–127

    Article  MathSciNet  Google Scholar 

  3. Zadeh L A. Some reflections on soft computing, granular computing and their roles in the conception, design and utilization of information/intelligent system. Soft Comp, 1998, 2(1): 23–25

    Google Scholar 

  4. Zadeh L A. Fuzzy sets and information granularity. In: Gupta N, Ragade R, Yager R, eds. Advances in Fuzzy Set Theory and Application. Amsterdam: North-Holland, 1979. 3–18

    Google Scholar 

  5. Zhang W X, Wei L, Qi J J. Theory and method of attribute reduction in concept lattice. Sci China Ser E (in Chinese), 2005, 35(6): 628–639

    MathSciNet  Google Scholar 

  6. Zhang W X, Qiu G F, Wu W Z. Attribute reduction theory and approach to concept lattice. Sci China Ser F-Inf Sci, 2005, 48(6): 713–726

    Article  MATH  Google Scholar 

  7. Pawlak Z. Granularity of knowledge, indiscernibility and rough sets. In: Proceedings of 1998 IEEE International Conference on Fuzzy Systems, Heideberg: Physifca-Verlag, 1998. 106–110

    Google Scholar 

  8. Lin T Y. Granular computing on binary relations I: data mining and neighborhood systems, II: rough sets representations and belief functions. In: Polkowski L, Skowron A, eds. Rough Sets in Knowledge Discovery 1. Heidelberg: Physica-Verlag, 1998. 107–140

    Google Scholar 

  9. Klir G J. Basic issues of computing with granular computing. In: Proceedings of 1998 IEEE International Conference on Fuzzy Systems. 1998. 101–105

  10. Liang J Y, Qian Y H, Chu C Y, et al. Rough set approximation based on dynamic granulation. Lecture Notes in Artificial Intelligence, 2005, 3641: 701–708

    Google Scholar 

  11. Zhang J S, Leung Y, Xu Z B. Clustering methods by simulating visual systems. J Comp (in Chinese), 2001, 24(5): 496–501

    Google Scholar 

  12. Shi Z Z. Advanced Artificial Intelligence. Beijing: Science Press, 2006

    Google Scholar 

  13. Pawlak Z. Rough Sets: Theoretical Aspects of Reasoning about Data. Dordrecht: Kluwer Academic Publishers, 1991

    MATH  Google Scholar 

  14. Zhang B, Zhang L. Theory of Problem Solving with Applications. Beijing: Tsinghua University Press, 1990

    Google Scholar 

  15. Zhang L, Zhang B. Theory of fuzzy quotient space (methods of fuzzy granular computing). J Software (in Chinese), 2003, 14(4): 770–776

    MATH  Google Scholar 

  16. Zhang L, Zhang B. Fuzzy reasoning model under quotient space structure. Inf Sci, 2005, 173: 353–364

    Article  MATH  Google Scholar 

  17. Wierman M J. Measuring uncertainty in rough set theory. International J General Sys, 1999, 28(4): 283–297

    Article  MATH  MathSciNet  Google Scholar 

  18. Liang J Y, Shi Z Z. The information entropy, rough entropy and knowledge granulation in rough set theory. Int J Uncertainty, Fuzziness and Knowledge-Based Systems, 2004, 12(1): 37–46

    Article  MATH  MathSciNet  Google Scholar 

  19. Liang J Y, Xu Z B. The algorithm on knowledge reduction in incomplete information systems. Int J Uncertainty, Fuzziness and Knowledge-Based Systems, 2002, 24(1): 95–103

    Article  MathSciNet  Google Scholar 

  20. Liang J Y, Li D Y. Uncertainty and Knowledge Acquisition in Information Systems. Beijing: Science Press, 2005

    Google Scholar 

  21. Qian Y H, Liang J Y. Combination entropy and combination granulation in incomplete information system. Lecture Notes in Artificial Intelligence, 2006, 4062: 184–190

    Google Scholar 

  22. Shannon C E. The mathematical theory of communication. Bell Sys Tech J, 1948, 27(3, 4): 373–423, 623–656

    MathSciNet  Google Scholar 

  23. Düntsch I, Gediga G. Uncertainty measures of rough set prediction. Artif Intell, 1998, 106: 283–297

    Article  Google Scholar 

  24. Beaubouef T, Petry F E. Fuzzy rough set techniques for uncertainty processing in a relational database. Int J Intell Syst, 2000, 15(5): 389–424

    Article  MATH  Google Scholar 

  25. Beaubouef T, Petry F E, Arora G. Information-theoretic measures of uncertainty for rough sets and rough relational databases. Inf Sci, 1998, 109(1–4): 185–195

    Article  Google Scholar 

  26. De Luca A, Termini S. A definition of nonprobilistic entropy in the setting of fuzzy sets theory. Inf Contr, 1972, 20: 301–312

    Article  MATH  Google Scholar 

  27. Mi J S, Leung Y, Wu W Z. An uncertainty measure in partition-based fuzzy rough sets. Int J General Syst, 2005, 34(1): 77–90

    Article  MATH  MathSciNet  Google Scholar 

  28. Liang J Y, Chin K S, Dang C Y, et al. A new method for measuring uncertainty and fuzziness in rough set theory. Int J General Syst, 2002, 31(4): 331–342

    Article  MATH  MathSciNet  Google Scholar 

  29. Kryszkiewicz M. Rough set approach to incomplete information systems. Inf Sci, 1998, 112: 39–49

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to JiYe Liang.

Additional information

Supported by the National Natural Science Foundation of China (Grant No. 60773133), the National Key Basic Research and Pevelopment Program of China (973) (Grant No. 2007CB311002), and the National 863 Project (Grant No. 2007AA01Z165)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liang, J., Qian, Y. Information granules and entropy theory in information systems. Sci. China Ser. F-Inf. Sci. 51, 1427–1444 (2008). https://doi.org/10.1007/s11432-008-0113-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11432-008-0113-2

Keywords

Navigation