Other tests for the unicode normalization module. More...
Go to the source code of this file.
Enumerations | |
| enum | COMMENT |
| enum | SEPARATOR |
Functions | |
| getRow ($f) | |
| my_assert ($file, $line, $code) | |
| normalize_form_c ($c) | |
| The following section will be used for testing different normalization methods. | |
| normalize_form_c_php ($c) | |
| This set of functions is only useful if youve added a param to the following functions to force pure PHP usage. | |
| normalize_form_d ($c) | |
| normalize_form_d_php ($c) | |
| normalize_form_kc ($c) | |
| normalize_form_kc_php ($c) | |
| normalize_form_kd ($c) | |
| normalize_form_kd_php ($c) | |
| unichr ($c) | |
| unistr ($c) | |
Variables | |
| $count = 0 | |
| $f = fopen($file, "r") | |
| if(php_sapi_name()!= 'cli') | $file = "NormalizationTest.txt" |
| $lineNo = 0 | |
| if ($f!==false) | |
Detailed Description
Other tests for the unicode normalization module.
Definition in file UtfNormalTest2.php.
Enumeration Type Documentation
| enum COMMENT |
Definition at line 18 of file UtfNormalTest2.php.
| enum SEPARATOR |
Definition at line 21 of file UtfNormalTest2.php.
Function Documentation
| getRow | ( | $ | f | ) |
| my_assert | ( | $ | file, |
| $ | line, | ||
| $ | code | ||
| ) |
Definition at line 75 of file UtfNormalTest2.php.
| normalize_form_c | ( | $ | c | ) |
The following section will be used for testing different normalization methods.
- Pure PHP ~ no assertion errors ~ 6.25 minutes
- php_utfnormal.so or intl extension: both are wrappers around libicu so we list the version of libicu when making the comparison
- libicu Ubuntu 3.8.1-3ubuntu1.1 php 5.2.6-3ubuntu4.5 ~ 2200 assertion errors ~ 5 seconds ~ output: http://paste2.org/p/921566
- libicu Ubuntu 4.2.1-3 php 5.3.2-1ubuntu4.2 ~ 1384 assertion errors ~ 15 seconds ~ output: http://paste2.org/p/921435
- libicu Debian 4.4.1-5 php 5.3.2-1ubuntu4.2 ~ no assertion errors ~ 13 seconds
- Tests comparing pure PHP output with libicu output were added later and slow down the runtime.
Definition at line 54 of file UtfNormalTest2.php.
References UtfNormal\toNFC().
| normalize_form_c_php | ( | $ | c | ) |
This set of functions is only useful if youve added a param to the following functions to force pure PHP usage.
I decided not to commit that code since might produce a slowdown in the UTF normalization code just for the sake of these tests. -- hexmode
Definition at line 65 of file UtfNormalTest2.php.
References UtfNormal\toNFC().
| normalize_form_d | ( | $ | c | ) |
Definition at line 55 of file UtfNormalTest2.php.
References UtfNormal\toNFD().
| normalize_form_d_php | ( | $ | c | ) |
Definition at line 66 of file UtfNormalTest2.php.
References UtfNormal\toNFD().
| normalize_form_kc | ( | $ | c | ) |
Definition at line 56 of file UtfNormalTest2.php.
References UtfNormal\toNFKC().
| normalize_form_kc_php | ( | $ | c | ) |
Definition at line 67 of file UtfNormalTest2.php.
References UtfNormal\toNFKC().
| normalize_form_kd | ( | $ | c | ) |
Definition at line 57 of file UtfNormalTest2.php.
References UtfNormal\toNFKD().
| normalize_form_kd_php | ( | $ | c | ) |
Definition at line 68 of file UtfNormalTest2.php.
References UtfNormal\toNFKD().
| unichr | ( | $ | c | ) |
Definition at line 194 of file UtfNormalTest2.php.
| unistr | ( | $ | c | ) |
Definition at line 211 of file UtfNormalTest2.php.
Referenced by getRow().
Variable Documentation
| $count = 0 |
Definition at line 80 of file UtfNormalTest2.php.
Referenced by Benchmarker\bench(), ImageBuilder\buildTable(), Profiler\calltreeCount(), CheckStorage\check(), UserDupes\checkDupes(), NamespaceConflictChecker\checkNamespace(), LanguageBs\convertPlural(), LanguageHr\convertPlural(), LanguageMo\convertPlural(), LanguagePl\convertPlural(), LanguageRo\convertPlural(), LanguageSe\convertPlural(), LanguageSh\convertPlural(), LanguageSk\convertPlural(), LanguageSma\convertPlural(), LanguageAr\convertPlural(), LanguageCy\convertPlural(), LanguageSgs\convertPlural(), LanguageSr_ec\convertPlural(), LanguageSr_el\convertPlural(), LanguageAm\convertPlural(), LanguageBh\convertPlural(), LanguageFr\convertPlural(), LanguageGv\convertPlural(), LanguageMg\convertPlural(), LanguageHi\convertPlural(), LanguageNso\convertPlural(), LanguageTi\convertPlural(), LanguageTl\convertPlural(), LanguageLn\convertPlural(), LanguageMk\convertPlural(), LanguageMt\convertPlural(), LanguageCs\convertPlural(), LanguageWa\convertPlural(), LanguageLt\convertPlural(), LanguageLv\convertPlural(), LanguageBe\convertPlural(), LanguageBe_tarask\convertPlural(), LanguageGd\convertPlural(), LanguageDsb\convertPlural(), LanguageHsb\convertPlural(), LanguageSl\convertPlural(), LanguageCu\convertPlural(), LanguageGa\convertPlural(), LanguageHe\convertPlural(), LanguageHy\convertPlural(), LanguageUk\convertPlural(), LanguageRu\convertPlural(), LanguageKsh\convertPlural(), LanguageSr\convertPlural(), Language\convertPlural(), SpecialWatchlist\countItems(), Sanitizer\decodeCharReferencesAndNormalize(), CategoryViewer\doCategoryQuery(), PopulateRevisionLength\doDBUpdates(), FixExtLinksProtocolRelative\doDBUpdates(), PopulateParentId\doDBUpdates(), DeleteArchivedFilesImplementation\doDelete(), DeleteArchivedRevisionsImplementation\doDelete(), DeleteOldRevisions\doDelete(), SpecialRecentChanges\doHeader(), PopulateRevisionSha1\doSha1LegacyUpdates(), PopulateRevisionSha1\doSha1Updates(), MovePageForm\doSubmit(), ApiQueryTags\doTag(), MysqlUpdater\doTemplatelinksUpdate(), User\edits(), DatabaseBase\errorCount(), DatabasePostgres\estimateRowCount(), StorageTypeStats\execute(), RefreshImageCount\execute(), CheckBadRedirects\execute(), CleanupSpam\execute(), MigrateUserGroup\execute(), NukePage\execute(), RemoveUnusedAccounts\execute(), DeleteOrphanedRevisions\execute(), RenameDbPrefix\execute(), ApiQueryAllUsers\execute(), ApiQueryDeletedrevs\execute(), ApiQueryLangLinks\execute(), ApiQueryExternalLinks\execute(), ApiQueryIWLinks\execute(), ApiQueryFilearchive\execute(), ApiQueryContributions\execute(), ApiQueryImageInfo\execute(), ApiQueryBlocks\execute(), ApiQueryLogEvents\execute(), NukeNS\execute(), ApiQueryRevisions\execute(), PPFrame_DOM\expand(), TextPassDumper\finalOptionCheck(), CdbWriter_PHP\finish(), MostcategoriesPage\formatResult(), CategoryPager\formatRow(), ActiveUsersPager\formatRow(), CreditsAction\getContributors(), DeleteLogFormatter\getMessageParameters(), MessageCache\getMostUsedMessages(), SpecialEditWatchlist\getNormalForm(), WantedPagesPage\getQueryInfo(), RandomImageGenerator\getRandomWordPairs(), CheckLanguageCLI\help(), SearchHighlighter\highlightText(), ImagePage\imageLinks(), User\incEditCount(), LoginForm\incLoginThrottle(), DatabaseOracle\indexExists(), TableCleanup\init(), ImageBuilder\init(), RemoveUnusedAccounts\isInactiveAccount(), Fallback\mb_substr(), SpecialMergeHistory\merge(), Title\moveSubpages(), moveToExternal(), ChangesList\numberofWatchingusers(), ImagePage\openShowImage(), SpecialSpecialpages\outputPageList(), CoreParserFunctions\pagesincategory(), PPFuzzTester\pickEntryPoint(), User\pingLimiter(), RebuildTextIndex\populateSearchIndex(), Language\preConvertPlural(), Preprocessor_Hash\preprocessToObj(), LockServerDaemon\purgeExpiredLocks(), PurgeRedundantText(), Maintenance\purgeRedundantText(), AllmessagesTablePager\reallyDoQuery(), EnhancedChangesList\recentChangesBlockGroup(), DatabasePostgres\relationExists(), DbTestPreviewer\report(), ApiQueryImages\run(), ApiQueryProtectedTitles\run(), ApiQueryLangBacklinks\run(), ApiQuerySearch\run(), ApiQueryIWBacklinks\run(), ApiQueryWatchlistRaw\run(), ApiQueryExtLinksUsage\run(), ApiQueryDuplicateFiles\run(), ApiQueryCategoryMembers\run(), ApiQueryAllLinks\run(), ApiQueryCategories\run(), ApiQueryAllCategories\run(), ApiQueryWatchlist\run(), ApiQueryAllpages\run(), ApiQueryQueryPage\run(), ApiQueryAllimages\run(), ApiQueryLinks\run(), ApiQueryRandom\run(), ApiQueryRecentChanges\run(), ApiQueryBacklinks\run(), ApiQueryRandom\runQuery(), TableCleanup\runTable(), Maintenance\shouldExecute(), UserrightsPage\showEditUserGroupsForm(), MovePageForm\showSubpages(), SpecialAllpages\showToplevel(), SpecialUpload\showViewDeletedLinks(), SearchHighlighter\splitAndAdd(), SevenZipStream\stream_read(), UploadSourceAdapter\stream_read(), DatabaseIbm_db2\tableExists(), DatabaseOracle\tableExists(), userOptions\USAGER(), Linker\userToolLinks(), Exif\validate(), and wfIncrStats().
| $f = fopen($file, "r") |
Definition at line 23 of file UtfNormalTest2.php.
Referenced by MWMemcached\_flush_read_buffer(), MWMemcached\_safe_fwrite(), CheckSyntax\buildFileList(), MimeMagic\doGuessMimeType(), WikiRevision\downloadSource(), ApiParamInfo\execute(), CheckSyntax\execute(), ForeignAPIRepo\fileExistsBatch(), findAuxFile(), JSParser\FunctionDefinition(), DeletedContributionsPage\getForm(), BmpHandler\getImageSize(), MimeMagic\getMediaType(), getRow(), Maintenance\getStdin(), XCFHandler\getXCFMetaData(), JSParser\parse(), ConverterRule\parseFlags(), ChangesList\recentChangesFlags(), ImageGallery\setShowBytes(), ImageGallery\setShowFilename(), StoreBatchTest\storecohort(), FileRepoTest\testFileRepoConstructionOptionCanNotBeAnEmptyArray(), FileRepoTest\testFileRepoConstructionOptionCanNotBeNull(), FileRepoTest\testFileRepoConstructionOptionNeedBackendKey(), FileRepoTest\testFileRepoConstructionOptionNeedNameKey(), FileRepoTest\testFileRepoConstructionWithRequiredOptions(), IPTest\testInvalidIPs(), GlobalTest\testReadOnlySet(), IPTest\testValidIPs(), wfBacktrace(), and SpecialWhatLinksHere\whatlinkshereForm().
| if (php_sapi_name()!= 'cli') $file = "NormalizationTest.txt" |
Definition at line 15 of file UtfNormalTest2.php.
Referenced by SpecialPage\__call(), ExtensionsTestSuite\__construct(), XmlTypeCheck\__construct(), SpecialPage\__construct(), DumpFileOutput\__construct(), DumpPipeOutput\__construct(), DumpGZipOutput\__construct(), DumpBZip2Output\__construct(), Dump7ZipOutput\__construct(), UnlistedSpecialPage\__construct(), IncludableSpecialPage\__construct(), CheckSyntax\addDirectoryContent(), ImageBuilder\addMissingImage(), OutputPage\addScriptFile(), SpecialUpload\ajaxGetExistsWarning(), DatabaseSqlite\attachDatabase(), OutputPage\buildCssLinksArray(), CheckSyntax\buildFileList(), TiffHandler\canRender(), ImageHandler\canRender(), CheckSyntax\checkEvilToken(), CheckSyntax\checkFileWithCli(), CheckSyntax\checkFileWithParsekit(), CheckSyntax\checkForMistakes(), CheckSyntax\checkRegex(), Sqlite\checkSqlSyntax(), UploadBase\checkXMLEncodingMissmatch(), FileRepo\cleanupBatch(), XMPTest\dataXMPParse(), ImagePage\delete(), ApiDelete\deleteFile(), UploadFromUrlTest\deleteFile(), ApiTestCaseUpload\deleteFileByTitle(), UploadFromUrlTestSuite\deleteFiles(), ParserTest\deleteFiles(), FileBackendTest\deleteFiles(), MimeMagic\detectMimeType(), UploadBase\detectScript(), UploadBase\detectVirus(), Installer\dirIsExecutable(), PopulateImageSha1\doDBUpdates(), MimeMagic\doGuessMimeType(), RevDel_FileList\doPostCommitUpdates(), MovePageForm\doSubmit(), FileBackendTest\doTestGetFileList(), DjVuImage\dump(), DumpDBZip2Output\DumpDBZip2Output(), DjVuImage\dumpForm(), ParserTest\dumpToFile(), CheckAutoLoader\execute(), CountMessages\execute(), MwSql\execute(), CheckImages\execute(), ApiQueryStashImageInfo\execute(), UpdateSpecialPages\execute(), SpecialFilepath\execute(), PatchSql\execute(), ApiQueryFilearchive\execute(), DeleteBatch\execute(), MoveBatch\execute(), UpdateSearchIndex\execute(), RefreshImageMetadata\execute(), SpecialUndelete\execute(), MWInit\extCompiledPath(), MWInit\extInterpretedPath(), Parser\fetchFileAndTitle(), FileRepo\fileExists(), ForeignAPIRepo\fileExistsBatch(), FileRepo\fileExistsBatch(), CoreParserFunctions\filepath(), UploadDumper\filterItem(), findAuxFile(), Installer\findExtensions(), RepoGroup\findFileFromKey(), findFiles(), FileRepo\findFiles(), ApiParse\formatCss(), SpecialUndelete\formatFileRow(), SvgHandler\formatMetadata(), ImageListPager\formatValue(), GenerateNormalizerData\generateArabic(), GenerateCollationData\generateFirstChars(), Lang2Po\generatePo(), FindHooks\getBadHooksFromFile(), FindHooks\getBadHooksFromPath(), ImageHistoryPseudoPager\getBody(), Maintenance\getCoreScripts(), UploadForm\getDescriptionSection(), ImageHandler\getDimensionsString(), SpecialUpload\getDupeWarning(), WikiFilePage\getDuplicates(), SpecialUpload\getExistsWarning(), SpecialUndelete\getFileComment(), getFileCommentFromSourceWiki(), SpecialUndelete\getFileLink(), WebRequest\getFileName(), MWDebug\getFilesIncluded(), WebRequest\getFileSize(), WebRequest\getFileTempname(), SpecialUndelete\getFileUser(), getFileUserFromSourceWiki(), MediaHandler\getGeneralLongDesc(), MediaHandler\getGeneralShortDesc(), FindHooks\getHooksFromFile(), FindHooks\getHooksFromPath(), UploadBase\getImageInfo(), SvgHandler\getImageSize(), DjVuImage\getInfo(), ApiQueryImageInfo\getInfo(), CSSMin\getLocalFileReferences(), MWException\getLogMessage(), SvgHandler\getLongDesc(), MediaHandler\getLongDesc(), ImageHandler\getLongDesc(), Language\getMessagesFileName(), CSSMin\getMimeType(), DjVuImage\getMultiPageInfo(), CountMessages\getNumMessages(), DjVuImage\getPageInfo(), ExifBitmapHandler\getRotation(), ResourceLoaderFileModule\getScriptURLsForDebug(), MediaHandler\getShortDesc(), ImageHandler\getShortDesc(), Skin\getSkinNames(), ResourceLoaderFileModule\getStyleURLsForDebug(), ImageHistoryList\getThumbForLine(), ForeignAPIFile\getThumbnails(), LocalFile\getThumbnails(), WebRequest\getUploadError(), MimeMagic\guessMimeType(), ImageBuilder\imageCallback(), ImagePage\imageDupes(), ImageHistoryList\imageHistoryLine(), BackupReader\importFromFile(), BackupReader\importFromStdin(), WikiRevision\importUpload(), SpecialPage\init(), UploadStash\initFile(), MediaWiki\initializeArticle(), MWCryptRand\initialRandomState(), SvgHandler\isAnimatedImage(), CheckSyntax\isSuitableFile(), Title\isValidMoveTarget(), MessageCache\loadFromLocal(), BackupDumper\loadPlugin(), Installer\locateExecutable(), RecompressTracked\logToFile(), ApiBase\makeHelpMsg_callback(), Parser\makeImage(), Linker\makeImageLink2(), Linker\makeMediaLinkFile(), Linker\makeThumbLink2(), Linker\makeThumbLinkObj(), Title\moveTo(), BitmapHandler\mustRender(), ImportStreamSource\newFromFile(), OldLocalFile\newFromRow(), ForeignDBFile\newFromRow(), ArchivedFile\newFromRow(), ImportStreamSource\newFromURL(), ImageBuilder\oldimageCallback(), UploadDumper\outputItem(), SpecialUploadStash\outputLocallyScaledThumb(), SpecialUploadStash\outputRemoteScaledThumb(), SpecialUploadStash\outputThumbFromStash(), SeleniumConfig\parse_5_2_ini_file(), SpecialUploadStash\parseKey(), ApiUpload\performUpload(), PruneFileCache\prune_directory(), FileRepo\publishBatch(), PurgeDeletedFiles\purgeFromLogType(), LocalFile\purgeOldThumbnails(), LocalFile\purgeThumbList(), ForeignAPIFile\purgeThumbnails(), LocalFile\purgeThumbnails(), DjVuImage\readChunk(), CSSMin\remap(), CheckStorage\restoreText(), XmlTypeCheck\run(), ApiQueryAllimages\run(), MessageCache\saveToLocal(), MessageCache\saveToScript(), WikiFilePage\setFile(), ImagePage\setFile(), OutputPage\setFileVersion(), Dump7ZipOutput\setup7zCommand(), SqliteInstaller\setupDatabase(), SpecialUndelete\showFileConfirmationForm(), SpecialUploadStash\showUploads(), DjVuImage\skipChunk(), UploadBase\stashFile(), FileRepo\storeBatch(), FileBackendTest\tearDownFiles(), UploadStashTest\testBug29408(), GIFHandlerTest\testGetImageArea(), PNGHandlerTest\testGetImageArea(), GIFHandlerTest\testGetMetadata(), PNGHandlerTest\testGetMetadata(), BitmapScalingTest\testImageArea(), FormatMetadataTest\testInvalidDate(), PNGHandlerTest\testIsAnimanted(), GIFHandlerTest\testIsAnimanted(), ExifRotationTest\testMetadata(), ExifRotationTest\testMetadataNoAutoRotate(), BitmapScalingTest\testNormaliseParams(), ExifRotationTest\testRotationRendering(), ExifRotationTest\testRotationRenderingNoAutoRotate(), BitmapScalingTest\testTooBigImage(), BitmapScalingTest\testTooBigMustRenderImage(), JpegMetadataExtractorTest\testUtf8Comment(), LocalFileTest\testWfLocalFile(), Language\transformUsingPairFile(), Title\validateFileMoveOperation(), wfBacktrace(), wfErrorLog(), wfGetPrecompiledData(), wfWarn(), and XmlDumpWriter\writeUpload().
| $lineNo = 0 |
Definition at line 81 of file UtfNormalTest2.php.
Referenced by my_assert().
Definition at line 82 of file UtfNormalTest2.php.
