|
| 阅读上一个主题 :: 阅读下一个主题 |
| 作者 |
 也来谈谈熵 |
 |
| 所跟贴 |
也来谈谈熵 -- 人之初 - (1759 Byte) 2005-1-19 周三, 上午5:50 (772 reads) |
ltlee
[博客]
[个人文集]
游客
|
|
|
作者：Anonymous 在 罕见奇谈 发贴, 来自 http://www.hjclub.org
If I remember correctly, Shannon's entropy was developed as to measure information implicit in structureless strings of binary digits. It is as elegant and intuitive as it is simple.
But this approach also precludes the measurement of words whose meanings are highly context dependent. Hence words are not structureless and their informational content cannot be objectively defined. Of course, "axe" is a string of letters and it can be represented by a string of binary numbers. But the informational content of such string is different from the information represented by the meaning of the word "axe." Human languages are not computer languages. Human brains are not compilers. Computer languages and corresponding compilers are complete systems by themselves. Human languages are only complete with a society of human brains. In addition, the latter reflects and dependent on the people's living environment.
How some posters can make the leap from the entropy of words as binary strings to the entropy of words as meaningful units of concepts is totally beyond my understanding.
作者：Anonymous 在 罕见奇谈 发贴, 来自 http://www.hjclub.org |
|
|
| 返回顶端 |
|
 |
| |
|
|
您不能在本论坛发表新主题
您不能在本论坛回复主题
您不能在本论坛编辑自己的文章
您不能在本论坛删除自己的文章
您不能在本论坛发表投票
您不能在这个论坛添加附件
您不能在这个论坛下载文件
|
based on phpbb, All rights reserved.
|
