MediaWiki  REL1_24
Enumerations | Functions | Variables
UtfNormalTest2.php File Reference
UtfNormal

Other tests for the unicode normalization module. More...

Go to the source code of this file.

Enumerations

enum  COMMENT
enum  SEPARATOR

Functions

 getRow ($f)
 my_assert ($file, $line, $code)
 normalize_form_c ($c)
 The following section will be used for testing different normalization methods.
 normalize_form_c_php ($c)
 This set of functions is only useful if youve added a param to the following functions to force pure PHP usage.
 normalize_form_d ($c)
 normalize_form_d_php ($c)
 normalize_form_kc ($c)
 normalize_form_kc_php ($c)
 normalize_form_kd ($c)
 normalize_form_kd_php ($c)
 unichr ($c)
 unistr ($c)

Variables

 $count = 0
 $f = fopen( $file, "r" )
if(PHP_SAPI!= 'cli') $file = "NormalizationTest.txt"
 $lineNo = 0
 if ($f!==false)

Detailed Description

Other tests for the unicode normalization module.

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. http://www.gnu.org/copyleft/gpl.html

Definition in file UtfNormalTest2.php.

Enumeration Type Documentation

enum COMMENT

Definition at line 33 of file UtfNormalTest2.php.

enum SEPARATOR

Definition at line 36 of file UtfNormalTest2.php.

Function Documentation

getRow ( $  f)

Definition at line 251 of file UtfNormalTest2.php.

References $f, $ret, array(), as, and unistr().

my_assert ( $  file,
$  line,
$  code 
)

Definition at line 108 of file UtfNormalTest2.php.

References $lineNo, and global.

normalize_form_c ( $  c)

The following section will be used for testing different normalization methods.

  • Pure PHP ~ no assertion errors ~ 6.25 minutes
  • php_utfnormal.so or intl extension: both are wrappers around libicu so we list the version of libicu when making the comparison
  • libicu Ubuntu 3.8.1-3ubuntu1.1 php 5.2.6-3ubuntu4.5 ~ 2200 assertion errors ~ 5 seconds ~ output: http://paste2.org/p/921566
  • libicu Ubuntu 4.2.1-3 php 5.3.2-1ubuntu4.2 ~ 1384 assertion errors ~ 15 seconds ~ output: http://paste2.org/p/921435
  • libicu Debian 4.4.1-5 php 5.3.2-1ubuntu4.2 ~ no assertion errors ~ 13 seconds
  • Tests comparing pure PHP output with libicu output were added later and slow down the runtime.

Definition at line 64 of file UtfNormalTest2.php.

References UtfNormal\toNFC().

normalize_form_c_php ( $  c)

This set of functions is only useful if youve added a param to the following functions to force pure PHP usage.

I decided not to commit that code since might produce a slowdown in the UTF normalization code just for the sake of these tests. -- hexmode

Returns:
string

Definition at line 87 of file UtfNormalTest2.php.

References UtfNormal\toNFC().

normalize_form_d ( $  c)

Definition at line 68 of file UtfNormalTest2.php.

References UtfNormal\toNFD().

normalize_form_d_php ( $  c)

Definition at line 91 of file UtfNormalTest2.php.

References UtfNormal\toNFD().

normalize_form_kc ( $  c)

Definition at line 72 of file UtfNormalTest2.php.

References UtfNormal\toNFKC().

normalize_form_kc_php ( $  c)

Definition at line 95 of file UtfNormalTest2.php.

References UtfNormal\toNFKC().

normalize_form_kd ( $  c)

Definition at line 76 of file UtfNormalTest2.php.

References UtfNormal\toNFKD().

normalize_form_kd_php ( $  c)

Definition at line 99 of file UtfNormalTest2.php.

References UtfNormal\toNFKD().

unichr ( $  c)

Definition at line 230 of file UtfNormalTest2.php.

unistr ( $  c)

Definition at line 247 of file UtfNormalTest2.php.

Referenced by getRow().

Variable Documentation

$count = 0

Definition at line 116 of file UtfNormalTest2.php.

Referenced by ApiQueryORM\addResults(), Benchmarker\bench(), ImageBuilder\buildTable(), CheckStorage\check(), UserDupes\checkDupes(), LanguageKsh\convertPlural(), SpecialWatchlist\countItems(), Sanitizer\decodeCharReferencesAndNormalize(), PopulateParentId\doDBUpdates(), FixExtLinksProtocolRelative\doDBUpdates(), DeleteArchivedFilesImplementation\doDelete(), DeleteArchivedRevisionsImplementation\doDelete(), DeleteOldRevisions\doDelete(), SpecialRecentChanges\doHeader(), PopulateRevisionLength\doLenUpdates(), PopulateRevisionSha1\doSha1LegacyUpdates(), PopulateRevisionSha1\doSha1Updates(), ApiQueryTags\doTag(), MysqlUpdater\doTemplatelinksUpdate(), StorageTypeStats\execute(), CheckBadRedirects\execute(), ApiQueryExternalLinks\execute(), ApiQueryDeletedrevs\execute(), ApiQueryLangLinks\execute(), ApiQueryIWLinks\execute(), ApiQueryFilearchive\execute(), MigrateUserGroup\execute(), DeleteOrphanedRevisions\execute(), NukePage\execute(), RemoveUnusedAccounts\execute(), ApiFeedContributions\execute(), ApiQueryBlocks\execute(), ApiQueryContributions\execute(), ApiQueryLogEvents\execute(), ApiQueryPagePropNames\execute(), CleanupSpam\execute(), RefreshFileHeaders\execute(), RenameDbPrefix\execute(), ApiQueryImageInfo\execute(), ApiQueryAllUsers\execute(), ShowJobs\execute(), ApiQueryContributors\execute(), NukeNS\execute(), CopyFileBackend\execute(), UpdateCollation\execute(), ApiQueryRevisions\execute(), lessc\expandParentSelectors(), CdbWriterPHP\finish(), MostcategoriesPage\formatResult(), MostinterwikisPage\formatResult(), UsersPager\formatRow(), CreditsAction\getContributors(), InfoAction\getContributors(), ApiQueryUserInfo\getCurrentUserInfo(), User\getEditCount(), DeleteLogFormatter\getMessageParameters(), SpecialEditWatchlist\getNormalForm(), BacklinkCache\getNumLinks(), WantedPagesPage\getQueryInfo(), RandomImageGenerator\getRandomWordPairs(), SearchHighlighter\highlightText(), ImageBuilder\init(), RemoveUnusedAccounts\isInactiveAccount(), Fallback\mb_substr(), moveToExternal(), lessc\multiplySelectors(), SpecialSpecialpages\outputPageList(), MediaStatisticsPage\outputTableRow(), CheckLanguageCLI\outputText(), CheckLanguageCLI\outputWiki(), PurgeChangedPages\pageableSortedRows(), CoreParserFunctions\pagesincategory(), FormatJson\parse(), PPFuzzTester\pickEntryPoint(), MediaStatisticsPage\preprocessResults(), ApiQueryContinueTestBase\query(), lessc_parser\removeComments(), DbTestPreviewer\report(), ApiQueryIWBacklinks\run(), ApiQueryLangBacklinks\run(), ApiQueryImages\run(), ApiQueryProtectedTitles\run(), ApiQueryWatchlistRaw\run(), ApiQueryExtLinksUsage\run(), ApiQueryCategories\run(), ApiQueryDuplicateFiles\run(), ApiQueryAllCategories\run(), ApiQueryCategoryMembers\run(), ApiQueryPagesWithProp\run(), ApiQueryWatchlist\run(), ApiQuerySearch\run(), ApiQueryQueryPage\run(), ApiQueryAllPages\run(), ApiQueryLinks\run(), ApiQueryAllImages\run(), ApiQueryBacklinksprop\run(), ApiQueryRandom\run(), ApiQueryAllLinks\run(), ApiQueryRecentChanges\run(), ApiQueryRandom\runQuery(), UserrightsPage\showEditUserGroupsForm(), SearchHighlighter\splitAndAdd(), SevenZipStream\stream_read(), BloomCacheRedisTest\testBloomCache(), ApiEditPageTest\testEdit_redirect(), ApiEditPageTest\testEdit_redirectText(), ApiEditPageTest\testEditAppend(), ApiEditPageTest\testEditConflict(), ApiEditPageTest\testEditConflict_bug41990(), ApiEditPageTest\testEditConflict_newSection(), SiteTest\testSetAndRemovePath(), GenericArrayObjectTest\testUnset(), lessc_parser\throwError(), UserOptions\USAGER(), and wfIncrStats().

$f = fopen( $file, "r" )

Definition at line 38 of file UtfNormalTest2.php.

Referenced by LinkCache\addLinkObj(), CheckSyntax\buildFileList(), CheckSyntax\execute(), findAuxFile(), JSParser\FunctionDefinition(), HtmlFormatterTest\getHtmlData(), BmpHandler\getImageSize(), getRow(), XCFHandler\getXCFMetaData(), JSParser\parse(), ConverterRule\parseFlags(), lessc\reduce(), FileRepoTest\testFileRepoConstructionWithRequiredOptions(), TextContentTest\testGetParserOutput(), IPTest\testInvalidIPs(), HtmlFormatterTest\testQuickProcessing(), GlobalTest\testReadOnlySet(), IPTest\testValidIPs(), and wfBacktrace().

if (PHP_SAPI!= 'cli') $file = "NormalizationTest.txt"

Definition at line 30 of file UtfNormalTest2.php.

Referenced by ExtensionsTestSuite\__construct(), UnlistedSpecialPage\__construct(), DumpDBZip2Output\__construct(), IncludableSpecialPage\__construct(), DumpPipeOutput\__construct(), CheckSyntax\addDirectoryContent(), ImageBuilder\addMissingImage(), lessc\addParsedFile(), CheckSyntax\buildFileList(), GIFHandler\canAnimateThumbnail(), ImageHandler\canRender(), TiffHandler\canRender(), XCFHandler\canRender(), AutoLoaderTest\checkAutoLoadConf(), CheckSyntax\checkEvilToken(), CheckSyntax\checkFileWithCli(), CheckSyntax\checkFileWithParsekit(), CheckSyntax\checkForMistakes(), CheckSyntax\checkRegex(), Sqlite\checkSqlSyntax(), UploadBase\checkXMLEncodingMissmatch(), ApiDelete\deleteFile(), UploadFromUrlTest\deleteFile(), ApiTestCaseUpload\deleteFileByTitle(), UploadFromUrlTestSuite\deleteFiles(), UploadBase\detectScript(), UploadBase\detectVirus(), PopulateImageSha1\doDBUpdates(), TestFileOpPerformance\doPerfTest(), DjVuImage\dump(), DjVuImage\dumpForm(), CSSMin\encodeImageAsDataURI(), ApiQueryStashImageInfo\execute(), FindMissingFiles\execute(), CheckImages\execute(), ApiQueryFilearchive\execute(), MwSql\execute(), UpdateSpecialPages\execute(), UploadStashCleanup\execute(), EraseArchivedFile\execute(), GenerateNormalizerDataAr\execute(), RefreshFileHeaders\execute(), PatchSql\execute(), DeleteBatch\execute(), GenerateUtf8Case\execute(), ApiImageRotate\execute(), SpecialVersion\execute(), MoveBatch\execute(), UpdateSearchIndex\execute(), RefreshImageMetadata\execute(), UpdateMediaWiki\execute(), Parser\fetchFileNoRegister(), CoreParserFunctions\filepath(), UploadDumper\filterItem(), findAuxFile(), findFiles(), lessc\findImport(), SvgHandler\formatMetadata(), ImageListPager\formatValue(), GenerateCollationData\generateFirstChars(), FindHooks\getBadHooksFromFile(), FindHooks\getBadHooksFromPath(), MWDebug\getCallerDescription(), ImageHandler\getDimensionsString(), SpecialVersion\getExtAuthorsFileName(), SpecialVersion\getExtLicenseFileName(), getFileCommentFromSourceWiki(), MWDebug\getFilesIncluded(), getFileUserFromSourceWiki(), MediaHandler\getGeneralLongDesc(), MediaHandler\getGeneralShortDesc(), FindHooks\getHooksFromFile(), FindHooks\getHooksFromPath(), UploadBase\getImageInfo(), ImagePageTest\getImagePage(), ImagePage404Test\getImagePage(), SvgHandler\getImageSize(), DjVuImage\getInfo(), ApiQueryImageInfo\getInfo(), ImportTest\getInputStreamSource(), CSSMin\getLocalFileReferences(), MWExceptionHandler\getLogMessage(), ImageHandler\getLongDesc(), SvgHandler\getLongDesc(), MediaHandler\getLongDesc(), CSSMin\getMimeType(), DjVuImage\getMultiPageInfo(), DjVuImage\getPageInfo(), SpecialFilepath\getRedirect(), ExifBitmapHandler\getRotation(), ImageHandler\getShortDesc(), MediaHandler\getShortDesc(), SpecialPageAliasTest\getSpecialPageAliases(), ForeignAPIFile\getThumbnails(), TransformationalImageHandler\getThumbnailSource(), ImageBuilder\imageCallback(), BackupReader\importFromFile(), BackupReader\importFromStdin(), MWCryptRand\initialRandomState(), SvgHandler\isAnimatedImage(), TiffHandler\isExpensiveToThumbnail(), CheckSyntax\isSuitableFile(), RecompressTracked\logToFile(), Linker\makeImageLink(), Linker\makeImageLink2(), Linker\makeMediaLinkFile(), Linker\makeThumbLink2(), Linker\makeThumbLinkObj(), TransformationalImageHandler\mustRender(), ForeignDBFile\newFromRow(), ImageBuilder\oldimageCallback(), UploadDumper\outputItem(), SpecialUploadStash\outputLocallyScaledThumb(), SpecialUploadStash\outputRemoteScaledThumb(), SpecialUploadStash\outputThumbFromStash(), SpecialUploadStash\parseKey(), Linker\processResponsiveImages(), ResourcesTest\provideMediaStylesheets(), ResourcesTest\provideResourceFiles(), XMPTest\provideXMPParse(), PruneFileCache\prune_directory(), ForeignAPIFile\purgeThumbnails(), DjVuImage\readChunk(), CSSMin\remapOne(), CheckStorage\restoreText(), JpegHandler\rotate(), BitmapHandler\rotate(), ApiQueryDuplicateFiles\run(), ApiQueryAllImages\run(), SpecialUndelete\showFileConfirmationForm(), SpecialUploadStash\showUploads(), DjVuImage\skipChunk(), UploadBase\stashFile(), FileRepo\storeBatch(), FileTest\testCanAnimateThumbIfAppropriate(), SvgTest\testGetIndependentMetaArray(), JpegTest\testGetIndependentMetaArray(), DjVuTest\testGetPageDimensions(), DjVuTest\testGetPageText(), BitmapScalingTest\testImageArea(), FormatMetadataTest\testInvalidDate(), JpegTest\testInvalidFile(), JpegTest\testJpegMetadataExtraction(), ExifRotationTest\testMetadata(), ExifRotationTest\testMetadataAutoRotate(), ExifRotationTest\testMetadataAutoRotateUnsupported(), ExifRotationTest\testMetadataNoAutoRotate(), BitmapScalingTest\testNormaliseParams(), DjVuTest\testPageCount(), ExifRotationTest\testRotationRendering(), ExifRotationTest\testRotationRenderingNoAutoRotate(), BitmapScalingTest\testTooBigImage(), BitmapScalingTest\testTooBigMustRenderImage(), JpegMetadataExtractorTest\testUtf8Comment(), LocalFileTest\testWfLocalFile(), XmlTypeCheck\validateFromFile(), wfBacktrace(), wfErrorLog(), wfExtractThumbParams(), and wfGetPrecompiledData().

$lineNo = 0

Definition at line 117 of file UtfNormalTest2.php.

Referenced by my_assert().

if($f!==false)

Definition at line 118 of file UtfNormalTest2.php.