v2.3.0

[2.3.0] - 2024-12-11

Added

• Add the architecture diagram of sampled WAF logs when creating WAF log pipeline. #132
• Add the support of ingesting Aurora/RDS PostgreSQL logs. #122

Changed

• Replace Amazon SQS with Amazon EventBridge to mitigate the Amazon S3 Event Notifications creation failure. #12
• Redesigned the log ingestion workflow to ingest logs from RDS without the dependency of CloudWatch Logs. #102
• Reordered pipeline creation workflow: log type and analytics engine selection now occur first for AWS service log pipelines. #309

Fixed

• Fix the sampling rate validation issue to allow only positive integers when creating CloudFront real-time logs. #302
• Fix the issue that the pipeline cannot be created due to a lack of "iam:TagRole" permission in some AWS Accounts. #279
• Fix the issue that the content of Log Config detail may exceed the maximum length of the window. #275
• Fix the issue that the EKS DaemonSet Guide is not refreshed after editing the log config. #241
• Fix the user interface issue that a wrong S3 bucket prefix is using when creating WAF log pipeline if the logging has already been enabled. #67

v2.2.2

[2.2.2] - 2024-08-23

Changed

• Support editing the auto-generated Regular Expression of Nginx and Apache log in the Log Config. #301
• Adjusted the error logs from info level to error level in the log-processor function. #305

Fixed

• Fixed failed to retrieve instance status due to too many instances in the Instance Group details page. #298
• Remove the redundant sign in alert dialog modal when user session expired. #303
• Fixed the Grafana url validation failed with spaces when import a Grafana Server. #304

v2.2.1

[2.2.1] - 2024-07-22

Added

• Optimised instance list performance. #76
• Added support for using Unix epoch time format as the time key for single line text log type.

Fixed

• Fixed an issue that missing time key when editing JSON config. #296
• Fixed an issue that upgrading to v2.2.0 failed due to missing CMK permissions. #297

v2.2.0

[2.2.0] - 2024-06-20

Added

• Added support to install, configure, and monitor the Fluent Bit agent on Windows Server 2016/2019/2022 Instances. #76
• Added a log visualization template for Windows IIS (W3C Format) logs. #212
• Added a default tag "CLOSolutionCostAnalysis" to all resources created by the solution. #285
• Add support for tag propagation for resources when creating log pipelines, allowing customers to view all resources and associated costs at the pipeline level. #232
• Added support for ingesting and analyzing data in a specified S3 location using Light Engine. #233
• Added support for importing OpenSearch clusters with custom KMS encryption enabled. #172
• Added support for ingesting and analyzing AWS CloudTrail logs using Light Engine. #234
• Added support for ingesting and analyzing Syslog data using Light Engine. #235
• Added support for using Unix epoch time format as the time key in Log Config. #198
• Added support for Asia Pacific (Hyderabad), Asia Pacific (Jakarta), Asia Pacific (Melbourne), Israel (Tel Aviv), Canada (Calgary), Europe (Spain), Europe(Zurich), Middle East (UAE) regions. #230

Fixed

• Fixed an issue where creating a pipeline failed when Lambda reached concurrency limits. #141
• Fixed a bug where the system could not read properties of undefined ('accountId') when the Next button was clicked without selecting an Instance Group. #236
• Fixed an issue where logs were not received when using the solution-provisioned staging bucket in Light Engine. #237
• Fixed a permissions issue in the LogMerger State Machine within Light Engine: The S3ObjectMigration Lambda failed due to insufficient KMS permissions on the analytics S3 bucket. #272
• Fixed a bug that prevented instances from being listed when switching accounts on the Instance Group list page. #291

v2.1.2

[2.1.2] - 2024-03-19

Fixed

• Resolved a bug where upgrading from versions earlier than 2.1.0 led to the loss of S3 notifications, preventing the proper collection of logs from the S3 buffer. #261
• Addressed a problem where including the @timestamp field in log configurations caused failures in creating index_templates, leading to an inability to write data to OpenSearch. #262
• Fixed a bug in the log processor Lambda due to the absence of the 'batch_size' variable, causing process failures. #242
• Solved a deployment issue with the Log Analytics Pipeline, which previously could not deploy cross-account Lambda pipelines. #227
• Corrected an issue with the ALB Service Log Parser that resulted in the omission of numerous log lines. #243
• Amended an inaccurate warning message displayed during pipeline creation with an existing index in OpenSearch. #260
• Amended an inaccurate error messaging when deleting an Instance Group in application log pipelines. #229

Full Changelog: v2.1.1...v2.1.2

v2.1.1

[2.1.1] - 2023-12-05

Fixed

• Fixed the issue that Log ingestion error in light engine when not specified time key in the log config #220
• Fixed the issue that cannot deploy the Centralized Logging with OpenSearch solution in UAE region #221
• Fixed the issue that EC2 instances should not be added to the same Instance Group #128

v2.1.0

[2.1.0] - 2023-11-15

Added

• Added Light Engine to provide an Athena-based serverless and cost-effective log analytics engine to analyze infrequent access logs
• Added OpenSearch Ingestion to provide more log processing capabilities, with which OSI can provision compute resource OpenSearch Compute Units (OCU) and pay per ingestion capacity
• Supported parsing logs in nested JSON format
• Supported CloudTrail logs ingestion from the specified bucket manually

Fixed

• Fixed the issue that the solution cannot list instances when creating instance groups #214
• Fixed the issue that EC2 instances launched by the Auto Scaling group failed to pass the health check #202

v2.0.1

[2.0.1] - 2023-09-27

Fixed

• Automatically adjust log processor lambda request's body size based on Amazon OpenSearch Service data nodes instance type #119
• When creating Application log pipeline and selecting Nginx, default sample dashboard option to be "Yes" #192
• Monitoring page cannot show metrics when there is only one dot
• The time of the data point of the monitoring metrics does not match the time of the abscissa

v2.0.0

[2.0.0] - 2023-08-22

Added

• Log ingestion from S3 bucket to support more log sources #89
• Show logs and metrics of the log analytics pipelines #112
• Quickly enable alarms on log ingestion pipeline #113
• Show the AWS resource changes when importing AOS using automatic networking mode #53
• Log Agent Installation: Support of agent installation on AL2023 instances #88
• Support of multi-AZ standby enabled OpenSearch cluster when creating log pipelines #170
• Instance Group: Show error message on the console when the installation of log agent fails #169
• Support same index name in different OpenSearch clusters #166
• Installation: refresh the aws-exports.json once update the CloudFormation input parameters #161
• Application log pipeline: Add a step to choose Log Config during the application pipeline creation steps #159
• Log Agent: Auto rotation of Fluent Bit log file #158
• Instance group: Add an option to attach IAM policies to Instance Group managed EC2 instances automatically #151
• Domain management: Check the prerequisites of OpenSearch clusters before import OpenSearch clusters #148
• Support ingest WAF (associate with CloudFront) sampled logs to OpenSearch in other regions except us-east-1 #129

Fixed

• Log Config: Time key in Fluent Bit config for Spring Boot should be time type instead of None #71
• EventBridge will be disabled automatically if deleting instances in instance group #164
• Log Config should not be created without Regex/Log Format #163
• Lack of region check before creating WAF log pipeline #162
• The Fluent bit configuration file generated in sidecar deployment option has a wrong shared volume #160
• S3 access log dashboard: 5xx Code description is covered #157
• S3 access log dashboard: The Average Time Unit should be milliseconds #155
• Cross-account: Unable to get instance list and create instance group in CN region #156
• The OpenSearch information (e.g., version, data nodes) is not updated automatically after customer upgraded the cluster #150
• Cannot differentiate the Lambda for different AWS Service log pipeline based on Lambda description #146
• Fix data lost when cannot find the location with IP address using MaxMind database #126
• Syslog: Fix port conflict when adding & deleting new log source in parallel #174

Changed

• Minimize the permissions of EC2 log ingestion IAM role #154
• Minimize the privileges of cross-account access role #153
• Soft delete when removing OpenSearch domain #152
• Save ALB access logs of Nginx based proxy to S3 bucket #149
• Code refactor: DynamoDB design optimization and GraphQL API design optimization #147
• Minimize security group egress of the provisioned ECS #145
• WAF dashboard: Cannot filter results using nonTerminatingMatchingRules.action field #144

Removed

• Domain management: Remove the support of Elasticsearch engine #176

v1.0.3

[1.0.3] - 2023-06

Fixed

• Fix the log processor Lambda urllib3.util.ssl cannot import name 'DEFAULT_CIPHERS' issue #138
• Fix: fails cross-account EKS cluster import due to OICD provider #135