Advanced Pipeline Features
Discover Smart Models to Redefine your Search
Pipeline provides the below mentioned advanced features that are beyond concepts and entities.
Smart Expansion
Smart Expansion is a neural network based NLP technique which for a specified term detects variants, acronyms (if applicable) and related terms. These models are trained using proprietary techniques of The Digital Group.
It is trained only for general concepts and should be used if the search application is for content such as news and business. Training for the Biomedical domain is in progress and will be available soon.
The feature provides three types of expansions:
- Variants: It provides the variants of the specified term. The variants can be synonyms, spell corrections or even incorrect but commonly used spelling.
- Acronym: If the specified term has an acronym and it is frequently used, the system is capable of automatically detecting it.
- Related: The system automatically detects the closely related terms to the specified term, though these terms may not mean the same thing. For example, the input term “Europe” may get “European” as a related term. Related is not recommended to be directly used for query expansion in search application but makes a good candidate as an input for other intelligence or cases such as broadening the query for zero result queries.
The following are the steps to manage the smart expansions in a pipeline:
- Go to the Advanced tab and select the Smart Expansions checkbox.
- Optionally, specify the maximum number of expansions to be extracted.