basset-ir: Retrieve, transform and process text documents

Recommend this page to a friend!

Download Download

Info Documentation View files Files Install with Composer Install with Composer Download Download Reputation Support forum Blog Links

Ratings Unique User Downloads Download Rankings

Not enough user ratings Total: 173 All time: 8,807 This week: 62Up

Version License PHP version Categories

basset-ir 2.52 GNU Lesser Genera... 7.1 Algorithms , PHP 5 , Statistics , Text p...

Description

Author

Jericko Tejido

This package can retrieve, transform and process text documents.

It can take one or more text documents eventually from files and retrieve their contents to perform several types of processing to transform the documents. Currently it can:

- Extract text features
- Normalize text
- Evaluate text similarity
- Perform statistic calculations
- Split the text in tokens
- Generate stem strings from the text words

Innovation Award

PHP Programming Innovation award winner
April 2018
Winner

Prize: One big elePHPant Plush Mascott Word processing operations are very useful for applications that need to take some text written by humans and make sense out of it somehow.

This package can perform several types of word processing operations that can be useful for many types of PHP applications.

Manuel Lemos

[画像:Picture of Jericko Tejido]

Jericko Tejido

Performance Level

Name:	Jericko Tejido `<contact>`
Classes:	2 packages by Jericko Tejido
Country:	Philippines Philippines
Age:	???
All time rank:	3591	31 in Philippines Philippines
Week rank:	195 Up	2 in Philippines Philippines Up

Level 1 Star

Innovation award
Innovation award
Nominee: 1x

Winner: 1x

Documentation

Droopy

Build Status

Basset

Basset is a full-text PHP Information Retrieval library. This is a collection of developments in the field of IR and ported over to PHP for research purposes.

Basset provides different ways of searching through documents in a collection (ad-hoc retrieval), by applying advanced and experimental IR algorithms and/or techniques gathered from different Research studies and Conferences, most notably:

Documentation

You can read about it here

Using the Cranfield Collection and the sample.php file

The Cranfield Collection has been the pioneer collection in information retrieval to validate a system's effectiveness.

I've included the 1400 abstract Cranfield Collection as an XML file that you can parse into separate files.

The test file at tests/sample.php can be executed right away to do the parsing and do a search for a single test query. Customize it to your needs if needed.

You can read Cranfield/cranfield-collection/cranqrel for Glassgow's qrels result.

I've also included SMART system's stopword list for standardization (see stopwords/stopwords.txt).

Files folder image Files (200)

File	Role	Description
Files folder image`config` (1 file)
Files folder image`Cranfield` (1 file, 1 directory)
Files folder image`src` (1 directory)
Files folder image`stopwords` (1 file)
Files folder image`tests` (3 files, 1 directory)
`Accessible without login Plain text file .travis.yml`	Data	Auxiliary data
`Accessible without login Plain text file autoload.php`	Aux.	Auxiliary script
`Accessible without login Plain text file composer.json`	Data	Auxiliary data
`Accessible without login Plain text file LICENSE`	Lic.	License text
`Accessible without login Plain text file README.markdown`	Doc.	Documentation

Files folder image Files (200) / config

File	Role	Description
`Accessible without login Plain text file config.ini`	Data	Auxiliary data

Files folder image Files (200) / Cranfield

File	Role	Description
Files folder image`cranfield-collection` (4 files)
`Plain text file cranfield_parser.php`	Class	Class source

Files folder image Files (200) / Cranfield / cranfield-collection

File	Role	Description
`Accessible without login Plain text file cran.all.1400.xml-format.xml`	Data	Auxiliary data
`Accessible without login Plain text file cran.qry.xml-format.xml`	Data	Auxiliary data
`Accessible without login Plain text file cranqrel`	Data	Auxiliary data
`Accessible without login Plain text file cranqrel.readme`	Doc.	Documentation

Files folder image Files (200) / src

File	Role	Description
Files folder image`Basset` (16 directories)

Files folder image Files (200) / src / Basset

File	Role	Description
Files folder image`Collections` (2 files)
Files folder image`Documents` (3 files)
Files folder image`Expansion` (14 files)
Files folder image`Feature` (3 files)
Files folder image`Index` (6 files)
Files folder image`Math` (1 file)
Files folder image`MetaData` (1 file)
Files folder image`Metric` (31 files)
Files folder image`Models` (34 files, 7 directories)
Files folder image`Normalizers` (3 files)
Files folder image`Results` (2 files)
Files folder image`Search` (1 file)
Files folder image`Statistics` (3 files)
Files folder image`Stemmers` (3 files)
Files folder image`Tokenizers` (3 files)
Files folder image`Utils` (4 files)

Files folder image Files (200) / src / Basset / Collections

File	Role	Description
`Plain text file CollectionInterface.php`	Class	Class source
`Plain text file CollectionSet.php`	Class	Class source

Files folder image Files (200) / src / Basset / Documents

File	Role	Description
`Plain text file Document.php`	Class	Class source
`Plain text file DocumentInterface.php`	Class	Class source
`Plain text file TokensDocument.php`	Class	Class source

Files folder image Files (200) / src / Basset / Expansion

File	Role	Description
`Plain text file CauchyDE.php`	Class	Class source
`Plain text file CauchyDE.php`	Class	Class source
`Plain text file DifferentialEvolution.php`	Class	Class source
`Plain text file Feedback.php`	Class	Class source
`Plain text file GeneticAlgorithm.php`	Class	Class source
`Plain text file IdeDecHi.php`	Class	Class source
`Plain text file IdeRegular.php`	Class	Class source
`Plain text file PRFEAVSMInterface.php`	Class	Class source
`Plain text file PRFInterface.php`	Class	Class source
`Plain text file PRFVSMInterface.php`	Class	Class source
`Plain text file RelevanceModel.php`	Class	Class source
`Plain text file Rocchio.php`	Class	Class source
`Plain text file SelfAdaptiveDE.php`	Class	Class source
`Plain text file SelfAdaptiveDE.php`	Class	Class source

Files folder image Files (200) / src / Basset / Feature

File	Role	Description
`Plain text file FeatureExtraction.php`	Class	Class source
`Plain text file FeatureInterface.php`	Class	Class source
`Plain text file FeatureVector.php`	Class	Class source

Files folder image Files (200) / src / Basset / Index

File	Role	Description
`Plain text file Index.php`	Class	Class source
`Plain text file IndexEntry.php`	Class	Class source
`Plain text file IndexInterface.php`	Class	Class source
`Plain text file IndexManager.php`	Class	Class source
`Plain text file IndexReader.php`	Class	Class source
`Plain text file IndexWriter.php`	Class	Class source

Files folder image Files (200) / src / Basset / Math

File	Role	Description
`Plain text file Math.php`	Class	Class source

Files folder image Files (200) / src / Basset / MetaData

File	Role	Description
`Plain text file MetaData.php`	Class	Class source

Files folder image Files (200) / src / Basset / Metric

File	Role	Description
`Plain text file BrayCurtisDistance.php`	Class	Class source
`Plain text file CanberraDistance.php`	Class	Class source
`Plain text file ChebyshevDistance.php`	Class	Class source
`Plain text file ChiSquareDistance.php`	Class	Class source
`Plain text file CosineSimilarity.php`	Class	Class source
`Plain text file CzekanowskiSimilarity.php`	Class	Class source
`Plain text file DiceSimilarity.php`	Class	Class source
`Plain text file DistanceInterface.php`	Class	Class source
`Plain text file EuclideanDistance.php`	Class	Class source
`Plain text file HellingerDistance.php`	Class	Class source
`Plain text file JaccardIndex.php`	Class	Class source
`Plain text file JSDivergence.php`	Class	Class source
`Plain text file KLDivergence.php`	Class	Class source
`Plain text file KulczynskiDistance.php`	Class	Class source
`Plain text file LorentzianDistance.php`	Class	Class source
`Plain text file MatusitaDistance.php`	Class	Class source
`Plain text file Metric.php`	Class	Class source
`Plain text file MetricInterface.php`	Class	Class source
`Plain text file MotykaSimilarity.php`	Class	Class source
`Plain text file OverlapCoefficient.php`	Class	Class source
`Plain text file RenyiDivergence.php`	Class	Class source
`Plain text file RuzickaSimilarity.php`	Class	Class source
`Plain text file SimilarityInterface.php`	Class	Class source
`Plain text file SoergleDistance.php`	Class	Class source
`Plain text file SqrtCosineSimilarity.php`	Class	Class source
`Plain text file StamatatosDistance.php`	Class	Class source
`Plain text file test.php`	Class	Class source
`Plain text file TriangleSectorSimilarity.php`	Class	Class source
`Plain text file TverskyIndex.php`	Class	Class source
`Plain text file VectorSimilarity.php`	Class	Class source
`Plain text file VSMInterface.php`	Class	Class source

Files folder image Files (200) / src / Basset / Models

File	Role	Description
Files folder image`Contracts` (5 files)
Files folder image`DFIModels` (5 files)
Files folder image`DFRAfterEffect` (4 files)
Files folder image`DFRModels` (8 files)
Files folder image`IBDistribution` (3 files)
Files folder image`IBLambda` (4 files)
Files folder image`Normalization` (11 files)
`Plain text file AbsoluteDiscountingLM.php`	Class	Class source
`Plain text file AtireBM25.php`	Class	Class source
`Plain text file BaseIdf.php`	Class	Class source
`Plain text file BM25.php`	Class	Class source
`Plain text file BM25L.php`	Class	Class source
`Plain text file BM25Plus.php`	Class	Class source
`Plain text file BSDS.php`	Class	Class source
`Plain text file DFIModel.php`	Class	Class source
`Plain text file DFRModel.php`	Class	Class source
`Plain text file DirichletLM.php`	Class	Class source
`Plain text file DirichletSPUD.php`	Class	Class source
`Plain text file HiemstraLM.php`	Class	Class source
`Plain text file IBModel.php`	Class	Class source
`Plain text file Idf.php`	Class	Class source
`Plain text file IdfDFR.php`	Class	Class source
`Plain text file IdfOkapi.php`	Class	Class source
`Plain text file IdfSparckRobertson.php`	Class	Class source
`Plain text file IRRA12.php`	Class	Class source
`Plain text file JelinekMercerLM.php`	Class	Class source
`Plain text file JelinekMercerSPUD.php`	Class	Class source
`Plain text file LemurTfIdf.php`	Class	Class source
`Plain text file ModBM25.php`	Class	Class source
`Plain text file PivotedConcaveTF.php`	Class	Class source
`Plain text file PivotedConcaveTFIDF.php`	Class	Class source
`Plain text file PivotedTfIdf.php`	Class	Class source
`Plain text file TermCount.php`	Class	Class source
`Plain text file TermFrequency.php`	Class	Class source
`Plain text file TfConcaveK.php`	Class	Class source
`Plain text file TfConcaveLog.php`	Class	Class source
`Plain text file TfIdf.php`	Class	Class source
`Plain text file TfRobertson.php`	Class	Class source
`Plain text file TwoStageLM.php`	Class	Class source
`Plain text file WeightedModel.php`	Class	Class source
`Plain text file XSqrAM.php`	Class	Class source

Files folder image Files (200) / src / Basset / Models / Contracts

File	Role	Description
`Plain text file IDFInterface.php`	Class	Class source
`Plain text file LanguageModelInterface.php`	Class	Class source
`Plain text file ProbabilisticModelInterface.php`	Class	Class source
`Plain text file TFInterface.php`	Class	Class source
`Plain text file WeightedModelInterface.php`	Class	Class source

Files folder image Files (200) / src / Basset / Models / DFIModels

File	Role	Description
`Plain text file ChiSquared.php`	Class	Class source
`Plain text file DFIInterface.php`	Class	Class source
`Plain text file DFIModel.php`	Class	Class source
`Plain text file Saturated.php`	Class	Class source
`Plain text file Standardized.php`	Class	Class source

Files folder image Files (200) / src / Basset / Models / DFRAfterEffect

File	Role	Description
`Plain text file AfterEffect.php`	Class	Class source
`Plain text file AfterEffectInterface.php`	Class	Class source
`Plain text file B.php`	Class	Class source
`Plain text file L.php`	Class	Class source

Files folder image Files (200) / src / Basset / Models / DFRModels

File	Role	Description
`Plain text file BasicModel.php`	Class	Class source
`Plain text file BasicModelInterface.php`	Class	Class source
`Plain text file BE.php`	Class	Class source
`Plain text file G.php`	Class	Class source
`Plain text file In.php`	Class	Class source
`Plain text file InExp.php`	Class	Class source
`Plain text file InFreq.php`	Class	Class source
`Plain text file P.php`	Class	Class source

Files folder image Files (200) / src / Basset / Models / IBDistribution

File	Role	Description
`Plain text file IBDistributionInterface.php`	Class	Class source
`Plain text file LLDistribution.php`	Class	Class source
`Plain text file SPLDistribution.php`	Class	Class source

Files folder image Files (200) / src / Basset / Models / IBLambda

File	Role	Description
`Plain text file IBLambdaInterface.php`	Class	Class source
`Plain text file Lambda.php`	Class	Class source
`Plain text file LambdaDF.php`	Class	Class source
`Plain text file LambdaTTF.php`	Class	Class source

Files folder image Files (200) / src / Basset / Models / Normalization

File	Role	Description
`Plain text file Normalization.php`	Class	Class source
`Plain text file NormalizationBM25.php`	Class	Class source
`Plain text file NormalizationDP.php`	Class	Class source
`Plain text file NormalizationF.php`	Class	Class source
`Plain text file NormalizationH1.php`	Class	Class source
`Plain text file NormalizationH2.php`	Class	Class source
`Plain text file NormalizationH2E.php`	Class	Class source
`Plain text file NormalizationInterface.php`	Class	Class source
`Plain text file NormalizationJMDF.php`	Class	Class source
`Plain text file NormalizationJMTF.php`	Class	Class source
`Plain text file NormalizationP.php`	Class	Class source

Files folder image Files (200) / src / Basset / Normalizers

File	Role	Description
`Plain text file English.php`	Class	Class source
`Plain text file Normalizer.php`	Class	Class source
`Plain text file NormalizerInterface.php`	Class	Class source

Files folder image Files (200) / src / Basset / Results

File	Role	Description
`Plain text file ResultEntry.php`	Class	Class source
`Plain text file ResultSet.php`	Class	Class source

Files folder image Files (200) / src / Basset / Search

File	Role	Description
`Plain text file Search.php`	Class	Class source

Files folder image Files (200) / src / Basset / Statistics

File	Role	Description
`Plain text file CollectionStatistics.php`	Class	Class source
`Plain text file EntryStatistics.php`	Class	Class source
`Plain text file PostingStatistics.php`	Class	Class source

Files folder image Files (200) / src / Basset / Stemmers

File	Role	Description
`Plain text file RegexStemmer.php`	Class	Class source
`Plain text file Stemmer.php`	Class	Class source
`Plain text file StemmerInterface.php`	Class	Class source

Files folder image Files (200) / src / Basset / Tokenizers

File	Role	Description
`Plain text file TokenizerInterface.php`	Class	Class source
`Plain text file WhitespaceAndPunctuationTokenizer.php`	Class	Class source
`Plain text file WhitespaceTokenizer.php`	Class	Class source

Files folder image Files (200) / src / Basset / Utils

File	Role	Description
`Plain text file Serializer.php`	Class	Class source
`Plain text file StopWords.php`	Class	Class source
`Plain text file TransformationInterface.php`	Class	Class source
`Plain text file TransformationSet.php`	Class	Class source

Files folder image Files (200) / stopwords

File	Role	Description
`Accessible without login Plain text file stopwords.txt`	Doc.	Documentation

Files folder image Files (200) / tests

File	Role	Description
Files folder image`Basset` (3 directories)
`Accessible without login Plain text file bootstrap.php`	Aux.	Auxiliary script
`Accessible without login Plain text file phpunit.xml`	Data	Auxiliary data
`Plain text file sample.php`	Class	Class source

Files folder image Files (200) / tests / Basset

File	Role	Description
Files folder image`Documents` (3 files)
Files folder image`Metric` (25 files)
Files folder image`Tokenizers` (3 files)

Files folder image Files (200) / tests / Basset / Documents

File	Role	Description
`Plain text file BaseDocuments.php`	Class	Class source
`Plain text file DocumentsTest.php`	Class	Class source
`Plain text file TokensDocumentTest.php`	Class	Class source

Files folder image Files (200) / tests / Basset / Metric

File	Role	Description
`Plain text file BrayCurtisDistanceTest.php`	Class	Class source
`Plain text file CanberraDistanceTest.php`	Class	Class source
`Plain text file ChebyshevDistanceTest.php`	Class	Class source
`Plain text file ChiSquareDistanceTest.php`	Class	Class source
`Plain text file CosineSimilarityTest.php`	Class	Class source
`Plain text file CzekanowskiSimilarityTest.php`	Class	Class source
`Plain text file DiceSimilarityTest.php`	Class	Class source
`Plain text file EuclideanDistanceTest.php`	Class	Class source
`Plain text file HellingerDistanceTest.php`	Class	Class source
`Plain text file JaccardIndexTest.php`	Class	Class source
`Plain text file JSDivergenceTest.php`	Class	Class source
`Plain text file KLDivergenceTest.php`	Class	Class source
`Plain text file KulczynskiDistanceTest.php`	Class	Class source
`Plain text file LorentzianDistanceTest.php`	Class	Class source
`Plain text file MatusitaDistanceTest.php`	Class	Class source
`Plain text file MotykaSimilarityTest.php`	Class	Class source
`Plain text file OverlapCoefficientTest.php`	Class	Class source
`Plain text file RenyiDivergenceTest.php`	Class	Class source
`Plain text file RuzickaSimilarityTest.php`	Class	Class source
`Plain text file SoergleDistanceTest.php`	Class	Class source
`Plain text file SqrtCosineSimilarityTest.php`	Class	Class source
`Plain text file StamatatosDistanceTest.php`	Class	Class source
`Plain text file TriangleSectorSimilarityTest.php`	Class	Class source
`Plain text file TverskyIndexTest.php`	Class	Class source
`Plain text file VectorSimilarityTest.php`	Class	Class source

Files folder image Files (200) / tests / Basset / Tokenizers

File	Role	Description
`Plain text file BaseTokenizers.php`	Class	Class source
`Plain text file WhitespaceAndPunct...onTokenizerTest.php`	Class	Class source
`Plain text file WhitespaceTokenizerTest.php`	Class	Class source

The PHP Classes site has supported package installation using the Composer tool since 2013, as you may verify by reading this instructions page.

Install with Composer Install with Composer

Download basset-ir-2018年07月22日.zip 637KB

Download basset-ir-2018年07月22日.tar.gz 558KB

Install with Composer Install with Composer

Version Control Unique User Downloads Download Rankings

100%

Total: 173

This week: 0

All time: 8,807

This week: 62 Up

Applications that use this package

No pages of applications that use this class were specified.

Add link image If you know an application of this package, send a message to the author to add a link here.

About us About us Advertise on this site Advertise on this site Site map Site map Newsletter Newsletter Statistics Statistics Site tips Site tips Privacy policy Privacy policy Contact Contact

Icontem

For more information send a message to info at phpclasses dot org .