A port of phputf8 to a unified set of files. Provides multi-byte aware replacement string functions.
For UTF-8 support to work correctly, the following requirements must be met:
This file is licensed differently from the rest of Kohana. As a port of phputf8, this file is released under the LGPL.
Class declared in SYSPATH/classes/UTF8.php on line 3.
array
$calledList of called methods that have had their required file included.
array(0)
boolean
$server_utf8Does the server support UTF-8 natively?
bool TRUE
Recursively cleans arrays, objects, and strings. Removes ASCII control codes and converts to the requested charset while silently discarding incompatible characters.
UTF8::clean($_GET); // Clean GET data
mixed
$var
required - Variable to clean string
$charset
= NULL - Character set, defaults to Kohana::$charset mixed
public static function clean($var, $charset = null)
{
if (!$charset) {
// Use the application character set
$charset = Kohana::$charset;
}
if (is_array($var) OR is_object($var)) {
foreach ($var as $key => $val) {
// Recursion!
$var[UTF8::clean($key)] = UTF8::clean($val);
}
} elseif (is_string($var) AND $var !== '') {
// Remove control characters
$var = UTF8::strip_ascii_ctrl($var);
if (!UTF8::is_ascii($var)) {
// Temporarily save the mb_substitute_character() value into a variable
$mb_substitute_character = mb_substitute_character();
// Disable substituting illegal characters with the default '?' character
mb_substitute_character('none');
// convert encoding, this is expensive, used when $var is not ASCII
$var = mb_convert_encoding($var, $charset, $charset);
// Reset mb_substitute_character() value back to the original setting
mb_substitute_character($mb_substitute_character);
}
}
return $var;
}
Takes an array of ints representing the Unicode characters and returns a UTF-8 string. Astral planes are supported i.e. the ints in the input can be > 0xFFFF. Occurrences of the BOM are ignored. Surrogates are not allowed.
$str = UTF8::to_unicode($array);
The Original Code is Mozilla Communicator client code. The Initial Developer of the Original Code is Netscape Communications Corporation. Portions created by the Initial Developer are Copyright (C) 1998 the Initial Developer. Ported to PHP by Henri Sivonen hsivonen@iki.fi, see http://hsivonen.iki.fi/php-utf8/ Slight modifications to fit with phputf8 library by Harry Fuecks hfuecks@gmail.com.
array
$arr
required - $str unicode code points representing a string string
- Utf8 string of charactersboolean
- False if a code point cannot be foundpublic static function from_unicode($arr)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _from_unicode($arr);
}
Tests whether a string contains only 7-bit ASCII bytes. This is used to determine when to use native functions or UTF-8 functions.
$ascii = UTF8::is_ascii($str);
mixed
$str
required - String or array of strings to check boolean
public static function is_ascii($str)
{
if (is_array($str)) {
$str = implode($str);
}
return !preg_match('/[^\x00-\x7F]/S', $str);
}
Strips whitespace (or other UTF-8 characters) from the beginning of a string. This is a UTF8-aware version of ltrim.
$str = UTF8::ltrim($str);
string
$str
required - Input string string
$charlist
= NULL - String of characters to remove string
public static function ltrim($str, $charlist = null)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _ltrim($str, $charlist);
}
Returns the unicode ordinal for a character. This is a UTF8-aware version of ord.
$digit = UTF8::ord($character);
string
$chr
required - UTF-8 encoded character integer
public static function ord($chr)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _ord($chr);
}
Strips whitespace (or other UTF-8 characters) from the end of a string. This is a UTF8-aware version of rtrim.
$str = UTF8::rtrim($str);
string
$str
required - Input string string
$charlist
= NULL - String of characters to remove string
public static function rtrim($str, $charlist = null)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _rtrim($str, $charlist);
}
Returns a string or an array with all occurrences of search in subject (ignoring case) and replaced with the given replace value. This is a UTF8-aware version of str_ireplace.
This function is very slow compared to the native version. Avoid using it when possible.
string|array
$search
required - Text to replace string|array
$replace
required - Replacement text string|array
$str
required - Subject text byref integer
$count
= NULL - Number of matched and replaced needles will be returned via this parameter which is passed by reference Pads a UTF-8 string to a certain length with another string. This is a UTF8-aware version of str_pad.
$str = UTF8::str_pad($str, $length);
string
$str
required - Input string integer
$final_str_length
required - Desired string length after padding string
$pad_str
= string(1) " " - String to use as padding string
$pad_type
= integer 1 - Padding type: STR_PAD_RIGHT, STR_PAD_LEFT, or STR_PAD_BOTH string
public static function str_pad($str, $final_str_length, $pad_str = ' ', $pad_type = STR_PAD_RIGHT)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _str_pad($str, $final_str_length, $pad_str, $pad_type);
}
Converts a UTF-8 string to an array. This is a UTF8-aware version of str_split.
$array = UTF8::str_split($str);
string
$str
required - Input string integer
$split_length
= integer 1 - Maximum length of each chunk array
public static function str_split($str, $split_length = 1)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _str_split($str, $split_length);
}
Case-insensitive UTF-8 string comparison. This is a UTF8-aware version of strcasecmp.
$compare = UTF8::strcasecmp($str1, $str2);
string
$str1
required - String to compare string
$str2
required - String to compare integer
- Less than 0 if str1 is less than str2integer
- Greater than 0 if str1 is greater than str2integer
- 0 if they are equalpublic static function strcasecmp($str1, $str2)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _strcasecmp($str1, $str2);
}
Finds the length of the initial segment not matching mask. This is a UTF8-aware version of strcspn.
$found = UTF8::strcspn($str, $mask);
string
$str
required - Input string string
$mask
required - Mask for search integer
$offset
= NULL - Start position of the string to examine integer
$length
= NULL - Length of the string to examine integer
- Length of the initial segment that contains characters not in the maskpublic static function strcspn($str, $mask, $offset = null, $length = null)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _strcspn($str, $mask, $offset, $length);
}
Strips out device control codes in the ASCII range.
$str = UTF8::strip_ascii_ctrl($str);
string
$str
required - String to clean string
public static function strip_ascii_ctrl($str)
{
return preg_replace('/[\x00-\x08\x0B\x0C\x0E-\x1F\x7F]+/S', '', $str);
}
Strips out all non-7bit ASCII bytes.
$str = UTF8::strip_non_ascii($str);
string
$str
required - String to clean string
public static function strip_non_ascii($str)
{
return preg_replace('/[^\x00-\x7F]+/S', '', $str);
}
Case-insensitive UTF-8 version of strstr. Returns all of input string from the first occurrence of needle to the end. This is a UTF8-aware version of stristr.
$found = UTF8::stristr($str, $search);
string
$str
required - Input string string
$search
required - Needle string
- Matched substring if foundfalse
- If the substring was not foundpublic static function stristr($str, $search)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _stristr($str, $search);
}
Returns the length of the given string. This is a UTF8-aware version of strlen.
$length = UTF8::strlen($str);
string
$str
required - String being measured for length integer
public static function strlen($str)
{
if (UTF8::$server_utf8)
return mb_strlen($str, Kohana::$charset);
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _strlen($str);
}
Finds position of first occurrence of a UTF-8 string. This is a UTF8-aware version of strpos.
$position = UTF8::strpos($str, $search);
string
$str
required - Haystack string
$search
required - Needle integer
$offset
= integer 0 - Offset from which character in haystack to start searching integer
- Position of needleboolean
- False if the needle is not foundpublic static function strpos($str, $search, $offset = 0)
{
if (UTF8::$server_utf8)
return mb_strpos($str, $search, $offset, Kohana::$charset);
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _strpos($str, $search, $offset);
}
Reverses a UTF-8 string. This is a UTF8-aware version of strrev.
$str = UTF8::strrev($str);
string
$str
required - String to be reversed string
public static function strrev($str)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _strrev($str);
}
Finds position of last occurrence of a char in a UTF-8 string. This is a UTF8-aware version of strrpos.
$position = UTF8::strrpos($str, $search);
string
$str
required - Haystack string
$search
required - Needle integer
$offset
= integer 0 - Offset from which character in haystack to start searching integer
- Position of needleboolean
- False if the needle is not foundpublic static function strrpos($str, $search, $offset = 0)
{
if (UTF8::$server_utf8)
return mb_strrpos($str, $search, $offset, Kohana::$charset);
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _strrpos($str, $search, $offset);
}
Finds the length of the initial segment matching mask. This is a UTF8-aware version of strspn.
$found = UTF8::strspn($str, $mask);
string
$str
required - Input string string
$mask
required - Mask for search integer
$offset
= NULL - Start position of the string to examine integer
$length
= NULL - Length of the string to examine integer
- Length of the initial segment that contains characters in the maskpublic static function strspn($str, $mask, $offset = null, $length = null)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _strspn($str, $mask, $offset, $length);
}
Makes a UTF-8 string lowercase. This is a UTF8-aware version of strtolower.
$str = UTF8::strtolower($str);
string
$str
required - Mixed case string string
public static function strtolower($str)
{
if (UTF8::$server_utf8)
return mb_strtolower($str, Kohana::$charset);
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _strtolower($str);
}
Makes a UTF-8 string uppercase. This is a UTF8-aware version of strtoupper.
string
$str
required - Mixed case string string
public static function strtoupper($str)
{
if (UTF8::$server_utf8)
return mb_strtoupper($str, Kohana::$charset);
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _strtoupper($str);
}
Returns part of a UTF-8 string. This is a UTF8-aware version of substr.
$sub = UTF8::substr($str, $offset);
string
$str
required - Input string integer
$offset
required - Offset integer
$length
= NULL - Length limit string
public static function substr($str, $offset, $length = null)
{
if (UTF8::$server_utf8)
return ($length === null) ? mb_substr($str, $offset, mb_strlen($str), Kohana::$charset) : mb_substr($str, $offset, $length, Kohana::$charset);
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _substr($str, $offset, $length);
}
Replaces text within a portion of a UTF-8 string. This is a UTF8-aware version of substr_replace.
$str = UTF8::substr_replace($str, $replacement, $offset);
string
$str
required - Input string string
$replacement
required - Replacement string integer
$offset
required - Offset unknown
$length
= NULL string
public static function substr_replace($str, $replacement, $offset, $length = null)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _substr_replace($str, $replacement, $offset, $length);
}
Takes an UTF-8 string and returns an array of ints representing the Unicode characters. Astral planes are supported i.e. the ints in the output can be > 0xFFFF. Occurrences of the BOM are ignored. Surrogates are not allowed.
$array = UTF8::to_unicode($str);
The Original Code is Mozilla Communicator client code. The Initial Developer of the Original Code is Netscape Communications Corporation. Portions created by the Initial Developer are Copyright (C) 1998 the Initial Developer. Ported to PHP by Henri Sivonen hsivonen@iki.fi, see http://hsivonen.iki.fi/php-utf8/ Slight modifications to fit with phputf8 library by Harry Fuecks hfuecks@gmail.com
string
$str
required - UTF-8 encoded string array
- Unicode code pointsfalse
- If the string is invalidpublic static function to_unicode($str)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _to_unicode($str);
}
Replaces special/accented UTF-8 characters by ASCII-7 "equivalents".
$ascii = UTF8::transliterate_to_ascii($utf8);
string
$str
required - String to transliterate integer
$case
= integer 0 - -1 lowercase only, +1 uppercase only, 0 both cases string
public static function transliterate_to_ascii($str, $case = 0)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _transliterate_to_ascii($str, $case);
}
Strips whitespace (or other UTF-8 characters) from the beginning and end of a string. This is a UTF8-aware version of trim.
$str = UTF8::trim($str);
string
$str
required - Input string string
$charlist
= NULL - String of characters to remove string
public static function trim($str, $charlist = null)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _trim($str, $charlist);
}
Makes a UTF-8 string's first character uppercase. This is a UTF8-aware version of ucfirst.
$str = UTF8::ucfirst($str);
string
$str
required - Mixed case string string
public static function ucfirst($str)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _ucfirst($str);
}
Makes the first character of every word in a UTF-8 string uppercase. This is a UTF8-aware version of ucwords.
$str = UTF8::ucwords($str);
string
$str
required - Mixed case string string
public static function ucwords($str)
{
if (!isset(UTF8::$called[__FUNCTION__])) {
require Kohana::find_file('utf8', __FUNCTION__);
// Function has been called
UTF8::$called[__FUNCTION__] = true;
}
return _ucwords($str);
}