Discourse/discourse
Discourse/discourse
2
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2025-09-05 08:59:27 +08:00
Code Packages Activity Actions 11

More entropy for foreign titles

Browse source 
* Treat strings with non-ASCII characters as having more entropy
This commit is contained in:
Michael Brown 2013-06-07 14:47:07 -04:00
parent 5217602ec3
commit bb77d2c38b
2 changed files with 12 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
lib/text_sentinel.rb
View file

@ -21,8 +21,10 @@ class TextSentinel
end
# Entropy is a number of how many unique characters the string needs.
# Non-ASCII characters are weighted heavier since they contain more "information"
def entropy
@entropy ||= @text.to_s.strip.split('').uniq.size
chars = @text.to_s.strip.split('')
@entropy ||= chars.pack('M*'*chars.size).gsub("\n",'').split('=').uniq.size
end
def valid?