ACUVA

Your Accurate Search for New Technology

Announcing enhanced autoscaling for Amazon OpenSearch Ingestion pipelines

By

Amazon OpenSearch Ingestion now supports enhanced autoscaling capabilities, allowing pipelines to scale dynamically based on additional parameters, including Amazon SQS queue size, persistent buffer lag, and the number of incoming HTTP connections. These enhancements improves upon the existing scaling mechanism, which previously relied only on memory and CPU utilization, providing a more comprehensive and responsive scaling mechanism for your data ingestion workloads.

With these improvements, customers can build more resilient and efficient data ingestion pipelines that automatically adapt to varying workloads. The new autoscaling parameters help optimize resource utilization, reduce ingestion bottlenecks, and improve overall pipeline performance, making it easier to handle high-throughput data streams for log analytics, observability, and security analytics use cases.

The enhanced autoscaling capabilities are now available in all AWS Regions where Amazon OpenSearch Ingestion is currently offered . You can take advantage of these improvements by updating your existing pipelines or creating new pipelines through the Amazon OpenSearch Service console or APIs at no additional cost.

To learn more, see the Amazon OpenSearch Ingestion webpage and the Amazon OpenSearch Service Developer Guide .

Amazon SageMaker now offers 9 additional visual ETL transforms

By

Visual ETL in Amazon SageMaker now offers 9 new built-in transforms: “Derived column”, “Flatten”, “Add current timestamp”, “Explode array or map into rows”, “To timestamp”, “Array to columns”, “Intersect”, “Limit” and “Concatenate columns”.

Visual ETL in Amazon SageMaker provides a drag-and-drop interface for building ETL flows and authoring flows with Amazon Q Developer. With these new transforms, ETL developers can quickly build more sophisticated data pipelines without having to write custom code for common transform tasks. Each of these new transforms address a unique data processing need. For example, use “Derived column” to define a new column based on a math formula or SQL expression, use “To timestamp” to convert a column to timestamp type, or build a new string column using the values of other columns with an optional spacer with the “Concatenate columns” transform.

This new feature is now available in all AWS regions where Amazon SageMaker is available. Access the supported region list for the most up-to-date availability information.

To learn more, visit our Amazon SageMaker documentation .

Amazon CloudFront supports VPC Origin modification with CloudFront Functions

By

In November 2024, CloudFront Functions introduced origin modifications, allowing you to conditionally change origin servers on each request. Starting today, you can now use this capability with VPC Origins and origin groups, enabling you to create even more sophisticated routing policies for your applications delivered from CloudFront.

You can now create dynamic routing policies that direct individual requests between any origin, including VPC Origins, by simply providing the ID for the origin. For example, you can automatically route each request to different applications by creating weights to send a certain percentage of traffic to multiple backend services, all without updating your distribution configuration. You can also create new origin groups dynamically, with the ability to set multiple origins with failover criteria. For example, you can create custom failover logic to update the primary and failover origins based on viewer location or request headers to ensure viewers have the lowest possible latency.

These features are now available within CloudFront Functions at no additional charge. For more information, see the CloudFront Developer Guide . For examples of how to use origin modification, see our GitHub examples repository .
 

Amazon CloudWatch Logs increases maximum log event size to 1 MB

By

Amazon CloudWatch Logs now supports log events up to 1 MB in size, a 4x increase from the previous 256 KB limit. This enhancement applies to the CloudWatch Logs PutLogEvents API and OpenTelemetry Protocol (OTLP) endpoint.

Customers can now capture richer log data while maintaining data integrity, eliminating the need to truncate large events or split them across multiple entries. It is especially valuable for use cases such as stack traces, debug outputs, and detailed application and security audit logs, enabling simplified troubleshooting, enhanced security audit capabilities, and better visibility into application behavior.

The increased limit is automatically available in all AWS Regions where CloudWatch Logs is available, including the AWS GovCloud (US) Regions . For more information, visit the CloudWatch Logs documentation .
 

Amazon Security Lake achieves FedRamp High and Moderate authorization

By

Amazon Security Lake has achieved FedRAMP High authorization in AWS GovCloud (US) Region and FedRAMP Moderate in the US East and US West Regions. If you’re a federal agency, public sector organization, or enterprise with FedRAMP compliance requirements, you can now centralize your security data using Amazon Security Lake.

Amazon Security Lake automatically centralizes security data from AWS environments, SaaS providers, on premises, and cloud sources into a purpose-built data lake stored in your account. With Security Lake, you can get a more complete understanding of your security data across your entire organization. You can also improve the protection of your workloads, applications, and data. Security Lake has adopted the Open Cybersecurity Schema Framework (OCSF), an open standard that is part of the Linux Foundation. With OCSF support, the service normalizes and combines security data from AWS and a broad range of enterprise security data sources.

You can start with a 15-day free trial of Amazon Security Lake with a single-click in the AWS Management console. To learn more and get started, see the following resources:
 

Investment in GenAI soars while expectations for its capabilities sink

By

While investment in developing GenAI will increase 76% this year, expectations for GenAI’s capabilities are declining, says Gartner. This paradox will continue throughout this year and next. Spending on developing …

The post Investment in GenAI soars while expectations for its capabilities sink appeared first on Electronics News: Latest Industry Trends & Component Updates | Electronics Weekly .

Scroll Up