Named Entity Recognition available in i3 Process OOTB, mitigation of recent important vulnerabilities and foundation for new SEP service.

Improvements

• [FP-362] Named Entity Recognition is available! NER is a natural language processing method that extracts information from the plain text. It detects and categorizes requested subjects, such as names, locations, companies, products, as well as themes, topics, times or monetary values. i3 gained new Process stage and Reference configuration.
  • 
  • Example text: Kendall Jenner just bought an $8.55 million house in Beverly Hills - take a look inside
    • Entities detected:
      • Location: „Beverly Hills”
      • MonetaryValue: „$8.55 million”
      • Person: „Kendall Jenner”
• [FP-334] Multi-arch docker images: starting from this release, i3 images are now built for ARM64 architecture, which is more cost-effective in cloud environments
• [FP-87] Create a skeleton of new SEP: foundation for new SEP service is ready
• [FP-675] Mitigate "json stack overflow" vulnerability that allows attackers to cause a DoS via crafted JSON or XML data, more info here
• [FP-674] Mitigate "uncontrolled recursion in JSONArray" vulnerability that leads to a StackOverflowError exception, more info here
• [FP-671] Mitigate "constructor deserialization remote code execution" vulnerability, more info here 
• [FP-668] Upgrade Spring Boot to 2.7 the latest to mitigate i.e. the following vulnerabilities:
  • Spring Security logout not clearing security context
  • Uncontrolled resource consumption in json-smart
  • Spring Expression DoS vulnerability

Bug fixes

• [FP-729] The authentication provider token is not properly removed after sending it in the request header. It can be found in the logs, which can cause data leakage. ProfileConsumerAuthenticationFilter does not remove it properly
• [FP-676] Document removal during the processing with (rewritten) Elasticsearch Writer returns an error
• [FP-509] SharepointOnlineBinaryDownloader $value parameter is added as a query parameter but should be part of the path; more info here

Removals

• None

Versions of key components

• Elasticsearch 7.17.9
• Apache Solr 8.11.1
• OpenSearch 1.3.6
• MongoDB 4.4.18
• Neo4j 4.4.11

Changelog