Release Notes (PSP)

Speech Platform Public Release Fall 2022 (SPE v3.55)

Welcome to the page introducing the fall 2022 public release of the Phonexia Speech Platform. We have improved and released mainly Phonexia Speech Engine v3.55 (SPE, REST API).

 ❗ IMPORTANT ❗ 
Due to internal changes, the 3.55 release is not compatible with previous technology configuration files (*.bs). Therefore, when updating to version 3.55, it’s necessary to get current version of all technologies and models used in your deployment from Phonexia.
In other words, copying technologies/models from previous SPE installation won’t work and you would see various sorts of error messages when initializing the technologies.
If you are using customized STT model created by LMC, you need to re-create the customized model using current STT version and the original list of added words.

New Features and Fixes

Speech Engine: The 5^th generation of Speaker Identification (SID)

We are eager to introduce a new 5^th generation model XL5 of our Speaker Identification. Its main highlights are:

• The accuracy increased by 1 percentage point (a relative improvement of 33 %) – XL5 model vs. XL4 model.
• The processing speed of the XL5 model is the same or faster than that of the XL4 model.
• The backward voiceprint compatibility of the XL5 model with the XL4 model (compatibility is optional and needs to be explicitly enabled).

Speech Engine: Speech to Text (STT)

We have several exciting new features relevant to STT and KWS technologies:

• Czech (Czech Republic) language model updated (tech. model name: CS_CZ_6):
  We added new words to the language model, so recent frequent words like “COVID” are correctly transcribed.
• Slovak (Slovakia) language model updated (tech. model name: SK_SK_6):
  We added new words to the language model, so recent frequent words like “COVID” are correctly transcribed.
• German (Germany) new-generation model DE_DE_6:
  It is an upgrade of previous 4^th generation (DE_4) of STT/KWS.
  STT word accuracy (WAcc) is increased up to 90 % (up to 21.8 p.p. improvement).
• Russian (Russia) new-generation RU_RU_6 model:
  It is an upgrade of previous 5^th generation (RU_RU_5) of STT/KWS.
  STT word accuracy (WAcc) is increased up to 90,8 % (up to 7.1 p.p. improvement).
• Polish (Poland) new-generation PL_PL_6 model:
  It is an upgrade of previous 5^th generation (PL_PL_5) of STT/KWS.
  STT word accuracy (WAcc) is increased up to 85.3 % (up to 18.7 p.p. improvement).
• Italian (Italy) new-generation IT_IT_6 model:
  It is an upgrade of previous 3^rd generation (IT_IT_3) of STT/KWS.
  STT word accuracy (WAcc) is increased up to 78.2 % (up to 20 p.p. improvement).
• Dutch (Netherlands and Belgium) new-generation NL_6 model:
  It is an upgrade of previous 5^th generation (NL_NL_5) of STT/KWS.
  STT word accuracy (WAcc) is increased up to 86.1 % (up to 24 p.p. improvement).
• Arabic (Gulf, Kuwait) new-generation AR_KW_6 model:
  It is an upgrade of previous 4^th generation (AR_KW_4) of STT/KWS.
  STT word accuracy (WAcc) is increaed up to 57.9 % (up to 8.8 p.p. improvement).
• Georgian (Georgia) brand-new model KA_GE_6 released:
  It is a completely new model in the STT/KWS family.
  STT word accuracy (WAcc) is up to 66.4 %.
• Chinese Mandarin (China) brand-new model ZH_CN_6 released:
  It is a completely new model in STT/KWS family.
  STT word accuracy (WAcc) is up to 93.1 %.

Speech Engine: Other Technologies

• Speaker Diarization (DIAR XL4) – We solved the issue of an extreme (exponential) processing time increase on long recordings (the processing time increase is now linear).
• Automatic configuration of some Speech Engine (SPE) settings values – SPE is now more user-friendly as it can configure its workers settings automatically based on detected hardware and technologies configuration.
• Speech Engine (SPE) now distributed also via DockerHub – simply search for phonexia/spe.
• The CMD/CLI interface now part of Speech Engine (SPE) package – phxcmd[.exe] binary is now included in SPE’s folder, so technologies can be easily tested using command line interface.

Phonexia BROWSER Update

We finished small but important improvements:

• The Age column in Results pane now shows the numeric results instead of age groups; column name changed to Age (±10 years) to emphasize the results tolerance
• Added the Keyword Spotting highest confidence column in Results pane, showing the highest confidence value of all detected keywords in a recording (allowing to judge the relevance of the detection directly in the Results pane, without opening the recording)
  • Added corresponding Minimum confidence to display setting for Keyword Spotting, which allows to set the threshold for KWS results being displayed in the Results pane.

CMD/CLI Variant to Test Technologies

We reimplemented our command-line interfaces and joined them to one binary called phxcmd[.exe]. For compatibility with the previous versions, we also distribute scripts that replace old binaries.

Deprecated Features

In accordance with our Phonexia Product Support Lifecycle Policy and the release of our new technology models, we announce the following features to be deprecated and end of life:

TECHNOLOGY	DEPRECATED MODEL	STILL SUPPORTED LAST (PREVIOUS)
STT / KWS	AR_KW_4 FA_IR_4 IT_IT_3 NL_NL_4 PL_PL_4 RU_RU_4 RU_RU_FIN4 ZH1	AR_KW_6 FA_6 IT_IT_6 PL_PL_6 (PL_PL_5) RU_RU_6 (RU_RU_5) RU_RU_6 (RU_RU_5) ZH_CN_6
SID	L3 XL3	XL5 (L4) XL5 (XL4)

Deprecated means that the model is still available in the latest release of the Speech Engine (SPE v3.55) but will NOT be released in future SPE versions.

Removed Features

Dropped support for Windows 7 / Windows Server 2008 R2 and older.

We removed the following features as it was announced earlier to be deprecated.

TECHNOLOGY	REMOVED MODEL	STILL SUPPORTED LAST (PREVIOUS)
SID	S2 L2	XL5 (L4) XL5 (XL4)

Known Issues

There are no significant issues that we are aware of at the moment. As we are continuously working on the Speech Platform improvements, please help us by reporting any potential issues (see the “Sources and How to Get Help” section below).

Future Product Release Plan

For the next public release, we plan:

• a brand-new model to be released for the Bengali language (both STT & KWS technology, the expected model name is BN_6),
• a brand-new model to be released for the Kazakh language (both STT & KWS technology, the expected model name is KK_6).

The next release is planned for 30.03.2023.

 

Sources and How to Get Help

How to get help / Support updated – We updated the ticketing system for our partners/customers for easy bug reporting. The support is still available on the URL:
partner.phonexia.com/support

Partner Portal updated – We updated the knowledge base information for you. You are more than welcome to browse through our knowledge base.

For a complete list of the changes in SW, see these changelogs:

• SPE → CHANGELOG.txt included in the distribution or on Releases and Changelogs (SPE)
• BROWSER → CHANGELOG.txt included in the distribution or on Releases and Changelogs (Browser)

---

Previous Releases

Speech Platform public release Spring 2022 (SPE v3.50)

Hello, and welcome to the page introducing the Spring 2022 release of Phonexia Speech Platform. We improved and released mainly Phonexia Speech Engine v3.50 (SPE, REST API).

Major Changes: New Features and Fixes

Speech Engine: Speech to Text (STT)

We have several exciting new features relevant to STT and KWS technologies. Both technologies are part of the Speech Engine (SPE) component:

• Spanish (General) Model Released (Tech. Model Name: ES_6)
  It is an upgrade of the existing STT/KWS language (ES_ES_5) to the 6^th generation (ES_6). It provides an increased STT word accuracy (WAcc) of up to 95.2 % (an absolute improvement of 27.6 percentage points—model ES_6 vs. ES_ES_5), leading to more precise search results in audio content.
• Slovak (Slovakia) Model Released (Tech. Model Name: SK_SK_6)
  It is an upgrade of the existing STT/KWS language (SK_SK_5) to the 6^th generation (SK_SK_6). It provides an increased STT word accuracy (WAcc) of up to 88.3 % (an absolute improvement of 11.4 percentage points—model SK_SK_6 vs. SK_SK_5), leading to more precise search results in audio content.
• Turkish (Turkey) Model Released (Tech. Model Name: TR_TR_6)
  It is an upgrade of the existing STT/KWS language (TR_1) to the 6^th generation (TR_TR_6). It improves word accuracy (WAcc) by 9.8 percentage points (model TR_TR_6 vs. TR_1), leading to more precise search results in audio content.
• Farsi (Iran and Afghanistan) Model Released (Tech. Model Name: FA_6)
  It is an upgrade of the existing STT/KWS language (FA_IR4) to the 6^th generation (FA_6). It improves word accuracy (WAcc) by 25 percentage points (model FA_6 vs. FA_IR4), leading to more precise search results in audio content.
• New Decoder and VAD Configuration in STT Technology Models
  Thanks to a new decoder and VAD components added to our STT, the transcription accuracy (WAcc) has improved on average by 2 percentage points (compared absolutely to our original 6th generation models). The update was applied to all technology models (languages) of the 6th generation of STT and KWS.
• Improved Preferred Phrases in STT (All 6^th Generation Technology Models)
  • Custom words (such as names, slang expressions, etc.) can now be used in Preferred Phrases.
  • Single words can now be preferred without any limitations (until now, only single standalone words were allowed to be preferred).
• Classes in Preferred Phrases (the CS_CZ_6 Model Only)
  Classes can now be included in Preferred Phrases as a substitute for a group of words (for example, preferring the generic phrase ‘my name is “first_name”’ instead of a list of specific phrases such as ‘my name is Paul’, ‘my name is John’, etc.).

Speech Engine: Other technologies

• VAD Update (the GENERIC_3 Technology Model From v3.0.0 to v3.0.2)
  The VAD GENERIC_3 model was retrained and updated (to v3.0.2). It should now be slightly more robust on various telephony data. Users will benefit from a more precise segmentation of the speech and non-speech parts contained in an audio file.
• Important Memory Leak Fix in STT
  We applied an important fix to a memory leak that caused slower processing in all STT technology models. We recommend partners take advantage of this STT fix by updating to SPE v3.50.
• DB Engine Changed From MySQL to MariaDB
  Due to the end of life of MySQL 5.x (supported by SPE so far) and incompatibility of its successor MySQL 8.x, we switched the support of an alternative SPE caching database from MySQL to MariaDB. You can get more info about the SPE caching database in the ‘Understand SPE database‘ article.

Deprecated Features

Deprecated / Removed Technical Models

In accordance with our Phonexia Product Support Lifecycle Policy and the release of our new technology models, we announce the end of life for the following old models:

TECHNOLOGY	DEPRECATED MODEL	LAST (PREVIOUS) STILL SUPPORTED
AGE	L, S (*)	L4 (XL3, L3)
DIAR	O	XL4 (S, L)
GID	GENERIC	XL4, L4 (XL3)
LID	L, S (*)	L4 (XL3, L3)
STT	FA_IR_4 TR_1 ZH_1	FA_6 TR_TR_6 To Be Announced
KWS	FA_IR_4 TR_TR_3 ZH_1	FA_6 TR_TR_6 To Be Announced

Deprecated means that the model is still available in the latest release of Speech Engine (SPE v3.50) but will NOT be released in the future SPE versions.

(*) Both models were removed and will not be released in SPE v3.50.

 

Deprecated / Removed Command Line Interface Parameters

Several command line parameters seem not to be used by our partners and appear to be obsolete. Therefore, in accordance with our Phonexia Product Support Lifecycle Policy, we announce the end of life for the following parameters:

CLI/CMD	PARAMETERS	NOTE
LID Command Line “lid | lid.exe”	-active-langs str1,str2…	Deprecated
STT Command Line “stt | stt.exe”	-auto-scan-dir -move-input -no-locks -local-compliance str1,… -net-compliance str1,… -modif-delay num [3.5s] -stable-att-int num [3.5s] -cn-max-words-per-slot num [0] -cn-min-word-prob num [-70]	Removed
VAD Command Line “vad | vad.exe”	-nonspeech-lab -save-log -log-suffix str [log]	Deprecated

Note: There is no impact on the Speech Engine (SPE, REST API).

 

The End of Life for Several Applications

Several applications have not proved their maturity on the market and have not been used by our partners. Therefore, we announce the end of life for the following applications:

APP	FUNCTIONALITY	NOTE
Lobsper	An example of a simple load-balancing app, written in JAVA, on top of SPE.	Removed
Workflow	An example of a workflow (pipeline) processing app, written in JAVA, on top of SPE.	Removed
REST Server	An old REST server (from v2.x.x to v3.2.x, the SPE predecessor)	Removed
JAVA Wrapper	JAVA wrapper on top of the C++ API	Removed

Note: There is no impact on the Speech Engine (SPE, REST API).

 

Known Issues

There are no significant issues that we are aware of at the moment. As we are continuously working on the Speech Platform improvements, please help us by reporting any potential issues (see the “Sources and How to Get Help” section below).

Future Product Release Plan

For the next public release, we plan to:

• Upgrade the Polish model (STT / KWS technologies, the expected model name is PL_PL_6) – an improved accuracy is expected.
• Upgrade the Arabic Gulf model (STT / KWS technologies, the expected model name is AR_KW_6) – an improved accuracy is expected.
• Furthermore, we work on additional STT languages, KWS upgrades, and other technologies based on the requests from our partners and customers.

We also work hard on other products:

• Phonexia Voice Verify – a voice verification solution for contact centers to improve the security layer and customer experience.
• Phonexia Orbis – an on-premises software solution that enables the rapid investigation of audio recordings.

The next release of the Speech Platform Fall 2022 Public Release (the Speech Engine v3.55 and Phonexia Browser v3.55 components) is planned for 30.09.2022. The diagram below shows the release plan.

 

---

 

Speech Platform public release Fall 2021 (SPE v3.45)

Hello, and welcome to the page introducing the Fall 2021 release of Phonexia Speech Platform. We released two components:

• Phonexia Speech Engine v3.45 (SPE 3.45.0 released 2021-10-06) – the encapsulation of speech technologies (REST API)
• Phonexia Browser v3.45 (BROWSER 3.45.0 released 2021-10-08) – the client application on top of SPE (for technologies evaluation)

This page summarizes major changes, bug fixes, and known bugs. We also announce important future plans and the end of life here.

Major Changes: New Features and Fixes

Speech Engine: Speech to Text (STT)

We have several very interesting new features relevant to STT and KWS technologies. Both technologies are part of the Speech Engine (SPE) component:

• English (United States) model (tech.model name: EN_US_6) released
  It is the upgrade of the existing STT/KWS language (EN_US_5) to the 6^th generation (EN_US_6). It brings increased accuracy 8 % (WAcc, absolute; model EN_US_6 vs. EN_US_5) of the STT that will lead to more precise search results in audio content.
• Vietnamese (as spoken in Vietnam) model (tech.model name: VI_VN_6) released
  We add this to languages supported by STT/KWS. Partners/Customers can transcribe Vietnamese audio or enhance some search-in-audio applications. Again, it is the 6^th generation we use in automatic speech recognition technologies (i.e., STT, KWS, PHNREC) that will lead to more precise search results in audio content.
• Improved preferred phrases in STT– only in tech. model CS_CZ_6 (Czech)
  Custom words (not present in the baseline STT model – such as names, slang expressions, etc.) can now be used in preferred phrases. On top of that, this feature can replace the LMC functionality (add custom words dynamically with each transcription attempt with no permanent STT models created).
• Improved transcription accuracy in the 6^th generation of STT – only in tech. model CS_CZ_6 (Czech) and model EN_US_6 (English)
  Transcription accuracy was improved (thanks to the remastering of several internal components of STT) by more than 2% WER (absolute) on average compared to the original 6th generation model (SPE 3.40.5). An additional benefit is an improved transcription accuracy of the most important information (such as names and addresses). Improvements will be implemented into other 6^th generation models/languages soon.
• Language Model Customization (LMC) functionality added to SPE (production level BETA)
  LMC is now a native part of the Speech Engine.

Speech Engine: Other technologies

• XL4 technology model added to GenderID
  It brings compatibility with SID4_XL4. It saves the processing time significantly in the integration, where the voiceprint is extracted (resources consuming) from audio only once and sent for comparison (fast) to both SID4_XL4 and GID_XL4.
• VAD has been upgraded to a new generation (tech. model GENERIC_3)
  The model (GENERIC_3) was released for standalone Voice Activity Detection (VAD as part of SPE). It brings higher accuracy in such a fundamental task to recognize speech and non-speech (silence, ringing, etc.) correctly. Using this new generation in built-in VAD in STT CS_CZ_6 (Czech language), we see increased accuracy (WAcc) by approx. 2% absolute. The implementation into other tech. models of STT (i.e., languages) will follow. It does not influence the *ID technologies.
• SQE: Added Perceptual Evaluation of Speech Quality (PESQ) score estimation
  The PESQ estimation was added as another available metric of SQE. PESQ is a standard way of expressing speech quality as perceived by human beings.
• SQE: Real-time processing
  A new technology model SQE_STREAM was added for real-time quality estimation on streams.
• Added Speaker Clustering endpoint for SID4 (SURPRISE of this release)
  Allows to compare a set of voiceprints and receive clusters of those. It will bring another level of effectiveness in the task of finding similar speakers. This functionality is available only for SID4 technology (tech. model XL4 (recommended default) or L4 (faster but less precise than XL4)).

Speech Engine: Generic functionalities

• Custom request ID can be specified in the HTTP header X-Request-ID
  Useful for tracking down issues during application development
• Possibility to set a source port for an output stream
  Useful when symmetric RTP communication is needed
• Added /doc endpoint for serving REST API documentation in HTML format
  Get API documentation for your particular SPE version remotely, without physical access to SPE installation files

Phonexia Browser updates

We provide Phonexia Browser (a component of Speech Platform) for the basic evaluation of speech technologies. This is to help with the first use of our SPE component.

• LID language models and language packs management in Browser
  It allows users to e.g. easily customize the set of languages in LID language packs. Customers will benefit from increased precision of results by lowering the false positive scores on customer data. Available for all LID technological models. See Browser manual PDF for more details about how to use it.

 

Deprecated Features

BSAPI (C++ API) discontinued – ANNOUNCEMENT

We set the End of Life for BSAPI (our C++ API) for​ 2023-03-31 after discussion with partners/customers, who actively gave us feedback on C++ API​.
What does it mean for partners/customers?:

• Partners/customers with installed BSAPI version and valid Maintenance & Support can update to BSAPI v3.40.x (March 2021 release; x = latest)​ and ask for bug-fixes.​ BSAPI v.3.40.x to be bug-fixed in long-term (18+6 months (i.e., till 2023-03-31)) and BSAPI v3.45 was not released.​
• New and existing partners can use Speech Engine (RESP API) or our command-line interface version (CLI/CMD) or GUI applications (Phonexia Browser or Voice Inspector).

End of Life for technical models

Several new technical models have been released. So in accordance with our Phonexia Product Support Lifecycle Policy, we announce the end of life for the following models:

technology	model to be deprecated	note: latest model
STT + KWS + PHNREC	EN4 English (United States)	EN_US_6 English (United States)
STT + KWS + PHNREC	HR_HR4 Croatian (Croatia)	HR_HR_6 Croatian (Croatia)

 

Known Issues

Some of the important known issues we see and plan to work on:

• BROWSER: Only one VAD model presented even if multiple VAD models are available on SPE
• SPE: Preferred phrases work currently in CS_CZ_6 STT only – we will add it to other languages in upcoming updates

 

Release Plan for future

For the next public release, we plan to:

• Upgrade the Spanish model (technologies STT / KWS / PHNREC, the expected model name ES_ES_6) – improved accuracy expected.
• Add a new decoder and new VAD configuration to the existing STT technology model (i.e., languages in STT) – improved accuracy expected.

We also work hard on other products:

• Phonexia Voice Verify – a voice verification solution for contact centers to enhance the security layer.
• Phonexia Orbis – an on-premises software solution that enables the rapid investigation of audio recordings.

The next public release (v3.50) for the Speech Platform components (Speech Engine and Phonexia Browser) is planned for 30/3/2022. The diagram below shows the release plan.