AWS News Blog https://aws.amazon.com/blogs/aws/ Announcements, Updates, and Launches Thu, 13 Feb 2025 23:17:54 +0000 en-US hourly 1 AWS CloudTrail network activity events for VPC endpoints now generally available https://aws.amazon.com/blogs/aws/aws-cloudtrail-network-activity-events-for-vpc-endpoints-now-generally-available/ <![CDATA[Esra Kayabali]]> Thu, 13 Feb 2025 23:17:54 +0000 <![CDATA[Amazon VPC]]> <![CDATA[Announcements]]> <![CDATA[AWS CloudTrail]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[Management Tools]]> <![CDATA[News]]> 7fc908e07fcf378476e13ddc7c2fa148ee006962 AWS CloudTrail now offers network activity events for VPC endpoint logging, enabling comprehensive monitoring and recording of AWS API activity through VPC endpoints to enhance security visibility, detect unauthorized access, and prevent data exfiltration without requiring custom TLS traffic inspection solutions. <p>Today, I’m happy to announce the general availability of network activity events for <a href="https://aws.amazon.com/vpc/">Amazon Virtual Private Cloud (Amazon VPC)</a> endpoints in <a href="https://aws.amazon.com/cloudtrail/">AWS CloudTrail</a>. This feature helps you to record and monitor AWS API activity traversing your VPC endpoints, helping you strengthen your data perimeter and implement better detective controls.</p> <p>Previously, it was hard to detect potential data exfiltration attempts and unauthorized access to the resources within your network through VPC endpoints. While VPC endpoint policies could be configured to prevent access from external accounts, there was no built-in mechanism to log denied actions or detect when external credentials were used at a VPC endpoint. This often required you to build custom solutions to inspect and analyze TLS traffic, which could be operationally costly and negate the benefits of encrypted communications.</p> <p>With this new capability, you can now opt in to log all AWS API activity passing through your VPC endpoints. CloudTrail records these events as a new event type called network activity events, which capture both control plane and data plane actions passing through a VPC endpoint.</p> <p>Network activity events in CloudTrail provide several key benefits:</p> <ul> <li><strong>Comprehensive visibility</strong> – Log all API activity traversing VPC endpoints, regardless of the AWS account initiating the action.</li> <li><strong>External credential detection</strong> – Identify when credentials from outside your organization are accessing your VPC endpoint.</li> <li><strong>Data exfiltration prevention</strong> – Detect and investigate potential unauthorized data movement attempts.</li> <li><strong>Enhanced security monitoring</strong> – Gain insights into all AWS API activity at your VPC endpoints without the need to decrypt TLS traffic.</li> <li><strong>Visibility for regulatory compliance</strong> – Improve your ability to meet regulatory requirements by tracking all API activity passing through.</li> </ul> <p><span style="text-decoration: underline;"><strong>Getting started with network activity events for VPC endpoint logging<br> </strong></span>To enable network activity events, I go to the <a href="https://console.aws.amazon.com/cloudtrailv2">AWS CloudTrail</a> console and choose <strong>Trails</strong> in the navigation pane. I choose <strong>Create trail</strong> to create a new one. I enter a name in the <strong>Trail name</strong> field and choose an <a href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (Amazon S3)</a> bucket to store the event logs. When I create a trail in CloudTrail, I can specify an existing Amazon S3 bucket or create a new bucket to store my trail’s event logs.</p> <p>If you set <strong>Log file SSE-KMS encryption</strong> to <strong>Enabled</strong>, you have two options: Choose <strong>New</strong> to create a new <a href="https://aws.amazon.com/kms/">AWS Key Management Service (AWS KMS)</a> key or choose <strong>Existing</strong> to choose an existing KMS key. If you chose <strong>New</strong>, you need to type an alias in the <strong>AWS KMS alias</strong> field. CloudTrail encrypts your log files with this KMS key and adds the policy for you. The KMS key and Amazon S3 must be in the same AWS Region. For this example, I use an existing KMS key. I enter the alias in the <strong>AWS KMS alias</strong> field and leave the rest as default for this demo. I choose <strong>Next </strong>for the next step.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/23/01a-vpce-LaunchMarketingIntake-1442.png"><img class="alignnone size-full wp-image-93384" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/23/01a-vpce-LaunchMarketingIntake-1442.png" alt="" width="1675" height="802"></a></p> <p>In the <strong>Choose log events</strong> step, I choose <strong>Network activity events</strong> under <strong>Events</strong>. I choose the event source from the list of AWS services, such as <code>cloudtrail.amazonaws.com</code>, <code>ec2.amazonaws.com</code>, <code>kms.amazonaws.com</code>, <code>s3.amazonaws.com</code>, and <code>secretsmanager.amazonaws.com</code>. I add two network activity event sources for this demo. For the first source, I select <code>ec2.amazonaws.com</code> option. For <strong>Log selector template</strong>, I can use templates for common use cases or create fine-grained filters for specific scenarios. For example, to log all API activities traversing the VPC endpoint, I can choose the <strong>Log all events</strong> template. I choose <strong>Log network activity access denied events</strong> template to log only access denied events. Optionally, I can enter a name in the <strong>Selector name</strong> field to identify the log selector template, such as <strong>Include network activity events for Amazon EC2</strong>.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/23/02-vpce-LaunchMarketingIntake-1442.png"><img loading="lazy" class="alignnone size-full wp-image-93385" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/23/02-vpce-LaunchMarketingIntake-1442.png" alt="" width="1507" height="782"></a></p> <p>As a second example, I choose <strong>Custom</strong> to create custom filters on multiple fields, such as <strong>eventName</strong> and <strong>vpcEndpointId</strong>. I can specify specific VPC endpoint IDs or filter the results to include only the VPC endpoints that match specific criteria. For <strong>Advanced event selectors,</strong> I choose <strong>vpcEndpointId</strong> from the <strong>Field</strong> dropdown, choose <strong>equals</strong> as <strong>Operator</strong>, and enter the VPC endpoint ID. When I expand the JSON view, I can see my event selectors as a JSON block. I choose <strong>Next</strong> and after reviewing the selections, I choose <strong>Create trail</strong>.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/23/03-vpce-LaunchMarketingIntake-1442.png"><img loading="lazy" class="alignnone size-full wp-image-93386" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/23/03-vpce-LaunchMarketingIntake-1442.png" alt="" width="1388" height="813"></a></p> <p>After it’s configured, CloudTrail will begin logging network activity events for my VPC endpoints, helping me analyze and act on this data. To analyze AWS CloudTrail network activity events, you can use the CloudTrail console, <a href="https://aws.amazon.com/cli/">AWS Command Line Interface (AWS CLI)</a>, and <a href="https://aws.amazon.com/developer/tools/">AWS SDK</a> to retrieve relevant logs. You can also use <a href="https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-lake.html">CloudTrail Lake</a> to capture, store and analyze your network activity events. If you are using Trails, you can use <a href="https://aws.amazon.com/athena">Amazon Athena</a> to query and filter these events based on specific criteria. Regular analysis of these events can help you maintain security, comply with regulations, and optimize your network infrastructure in AWS.</p> <p><span style="text-decoration: underline;"><strong>Now available<br> </strong></span>CloudTrail network activity events for VPC endpoint logging provide you with a powerful tool to enhance your security posture, detect potential threats, and gain deeper insights into your VPC network traffic. This feature addresses your critical needs for comprehensive visibility and control over your AWS environments.</p> <p>Network activity events for VPC endpoints are available in all commercial AWS Regions.</p> <p>For pricing information, visit <a href="https://aws.amazon.com/cloudtrail/pricing/">AWS CloudTrail pricing</a>.</p> <p>To get started with CloudTrail network activity events, visit <a href="https://aws.amazon.com/cloudtrail/">AWS CloudTrail</a>. For more information on CloudTrail and its features, refer to the <a href="https://docs.aws.amazon.com/awscloudtrail/latest/userguide/logging-network-events-with-cloudtrail.html">AWS CloudTrail documentation</a>.</p> <a href="https://www.linkedin.com/in/esrakayabali/">— Esra</a> AWS Weekly Roundup: AWS Step Functions, AWS CloudFormation, Amazon Q Developer, and more (February 10, 2024) https://aws.amazon.com/blogs/aws/aws-weekly-roundup-aws-step-functions-aws-cloudformation-amazon-q-developer-and-more-february-10-2024/ <![CDATA[Matheus Guimaraes]]> Mon, 10 Feb 2025 19:27:49 +0000 <![CDATA[Amazon Q Developer]]> <![CDATA[Announcements]]> <![CDATA[AWS CloudFormation]]> <![CDATA[AWS Config]]> <![CDATA[AWS Step Functions]]> <![CDATA[Launch]]> <![CDATA[News]]> <![CDATA[Week in Review]]> 0030c50b5a1ed66591d4de6f3dcf83bcc7c52fe6 We are well settled into 2025 by now, but many people are still catching up with all the exciting new releases and announcements that came out of re:Invent last year. There have been hundreds of re:Invent recap events around the world since the beginning of the year, including in-person all-day official AWS events with multiple […] <p>We are well settled into 2025 by now, but many people are still catching up with all the exciting new releases and announcements that came out of re:Invent last year. There have been hundreds of re:Invent recap events around the world since the beginning of the year, including in-person all-day official AWS events with multiple tracks to help you discover and dive deeper into the releases you care about, as well as community and virtual events.</p> <p>Last month, I was lucky to be a co-host for AWS EMEA re:Invent re:Cap which was a nearly 4-hour livestream with experts featuring demos, whiteboard sessions, and a live Q&amp;A. The good news is that you can now <a href="https://aws.amazon.com/events/reinvent-recaps-emea/virtual-emea/">watch it on-demand</a>! We had a great team and thousands of people enjoyed learning through the virtual experience. I recommend you check it out or share it with colleagues who have not been able to attend any re:Invent re:Cap events.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/10/1738322193238.jpeg"><img loading="lazy" class="aligncenter size-full wp-image-93547" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/10/1738322193238.jpeg" alt="" width="2048" height="1536"></a></p> <p>The Korean team also did an amazing job hosting their own virtual re:Invent re:Cap event, and it’s also now <a href="https://pages.awscloud.com/aws-reinvent-recap-korea-reg.html">available on-demand</a>. So if you speak Korean I do recommend you check it out.</p> <p>If you’re more of a reader, then we have a treat for you. You can download the full official re:Invent re:Cap deck with all the slides covering releases across all areas by visiting <a href="https://community.aws/recaps">community.aws</a>! While there, you can also check all the upcoming in-person <a href="https://community.aws/recaps">re:Invent re:Cap community events</a> remaining across the globe for a chance to still attend one of those in a city near you.</p> <p>But as we know, new releases, announcements, and updates don’t stop at re:Invent. Every week there are even more, and this is why we have this Weekly Roundup series that you can read every Monday to get the AWS news highlights from the week before.</p> <p>So here’s what caught my attention last week.</p> <p><span style="text-decoration: underline;"><strong>Last week’s AWS Launches<br> </strong></span>If you use <a href="https://aws.amazon.com/step-functions/">AWS Step Functions</a> you may be interested in these:</p> <ul> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/02/aws-step-functions-data-source-output-option-distributed-map/">New data source and output options for Distributed Maps</a> – Distributed Maps area a great fit for large-scale parallel document processing. Now, in addition to the already existing support for JSON and CSV files, it can process JSONL, as well as semicolon or tab-delimited files. You can also use new output transformations such as FLATTEN to combine result sets without any additional code.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/02/aws-step-functions-100-000-state-machines-activities-account/">Default quota increased to 100,000 state machines and activities per AWS account</a> – the previous default quota for the number of registered state machines and activities per AWS account was 10,000, making this a 10x increase.</li> </ul> <p><a href="https://aws.amazon.com/q/developer/?gclid=CjwKCAiA5Ka9BhB5EiwA1ZVtvCe2pikrI0zk7rf-PKgldfyhJiidD917q08A6JrMmhNz-Hl8gXoBjRoCAwQQAvD_BwE&amp;trk=6ae1a2e1-f658-4e5b-9369-1049be12d384&amp;sc_channel=ps&amp;ef_id=CjwKCAiA5Ka9BhB5EiwA1ZVtvCe2pikrI0zk7rf-PKgldfyhJiidD917q08A6JrMmhNz-Hl8gXoBjRoCAwQQAvD_BwE:G:s&amp;s_kwcid=AL!4422!3!698165420143!e!!g!!amazon%20q%20developer!21048269256!162057017895">Amazon Q Developer</a> also got a couple of updates:</p> <ul> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/02/amazon-q-developer-experience-pro-tier-subscriptions/">New simplified setup experience for Amazon Q Developer Pro tier subscriptions</a> – You can now create Amazon Q Developer subscriptions for standalone or <a href="https://aws.amazon.com/organizations/">AWS Organizations</a> member accounts from the <a href="https://console.aws.amazon.com/amazonq/home">Amazon Q console</a> with a 2-step setup.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/02/amazon-q-developer-console-errors-aws-commercial-regions/">Amazon Q Developer can now troubleshoot console errors in all AWS Commercial Regions</a> – Amazon Q Developer helps you to diagnose common errors when working with <a href="https://aws.amazon.com/pm/ec2/">Amazon Elastic Compute Cloud (Amazon EC2)</a>, <a href="https://aws.amazon.com/ecs/">Amazon Elastic Container Service (Amazon ECS)</a>, <a href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (Amazon S3)</a>, <a href="https://aws.amazon.com/lambda/getting-started/">AWS Lambda</a> and <a href="https://aws.amazon.com/cloudformation/getting-started/">AWS CloudFormation</a> in the console. It can identity permissions issues, incorrect configurations, and more. This was previously limited to a few Regions, but now this feature has been made available to all AWS Commercial Regions.</li> </ul> <p>Here are some other releases that caught my attention this week from a variety of other AWS services:</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/02/reshape-aws-cloudformation-stack-refactoring/">AWS CloudFormation introduces stack refactoring</a> – You can now split your CloudFormation stacks, move resources from one stack to another, and change the logical name of resources within the same stack. This adds a lot of flexibility enabling you to keep up with changes within your organization and architectures, such as streamlining resource lifecycle management for existing stacks, keeping up with naming convention changes, and other cases. You can refactor your stacks by using the <a href="https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-getting-started.html">AWS command line interface (CLI)</a> or <a href="https://aws.amazon.com/developer/tools/">AWS SDK</a>.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/02/aws-config-4-new-resource-types/">AWS Config now supports 4 new release types</a> – <a href="https://aws.amazon.com/config/getting-started/">AWS Config</a> is great for monitoring resources across your AWS environment and help you towards ensuring alignment with your company and security policies as well as compliance requirements. It now has four new types of resources enabling you to monitor <a href="https://docs.aws.amazon.com/vpc/latest/userguide/what-is-amazon-vpc.html">Amazon VPC</a> block public access settings, any exceptions made within those settings, as well as monitor <a href="https://aws.amazon.com/s3/storage-classes/express-one-zone/">S3 Express One Zone</a> bucket policies and directory bucket settings.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/02/amazon-ec2-automated-recovery-microsoft-sql-server-vss/">Automated recovery of Microsoft SQL Server on EC2 instan ces with VSS</a> – You can now use a new feature called Volume Shadow Copy Services (VSS) to backup Microsoft SQL Server databases to <a href="https://aws.amazon.com/ebs/">Amazon Elastic Block Store</a> (EBS) snapshots while the database is running. You can then use <a href="https://aws.amazon.com/systems-manager/">AWS Systems Manager</a> Automation Runbook to set a recovery point of time of your preference and it will restore the database automatically from your VSS-based EBS snapshot without incurring any downtime.</p> <p>For a full list of AWS announcements, be sure to keep an eye on the <a href="https://aws.amazon.com/new/?whats-new-content-all.sort-by=item.additionalFields.postDateTime&amp;whats-new-content-all.sort-order=desc&amp;awsf.whats-new-categories=*all">What’s New with AWS page</a>.</p> <p><span style="text-decoration: underline;"><strong>Other updates</strong></span><br> <a href="https://aws.amazon.com/blogs/security/announcing-upcoming-changes-to-the-aws-security-token-service-global-endpoint/">Upcoming changes to the AWS Security Token Service (AWS STS) global endpoint</a> – To help improve the resiliency and performance of your applications, we are making changes to the AWS STS global endpoint (https://sts.amazonaws.com), with no action required from customers. Starting in early 2025, requests to the STS global endpoint will be automatically served in the same Region as your AWS deployed workloads. For example, if your application calls <em>sts.amazonaws.com</em> from the US West (Oregon) Region, your calls will be served locally in the US West (Oregon) Region instead of being served by the US East (N. Virginia) Region. These changes will be released in the coming weeks and we will gradually roll it out to AWS Regions that are enabled by default by mid-2025.</p> <p>Looking for some reading recommendations? At the beginning of every year Dr. Werner Vogles, VP and CTO of Amazon, publishes <a href="https://www.allthingsdistributed.com/2025/02/thinking-like-a-fox-a-reading-list-for-the-future.html">a list of recommended books</a> that he believes should have your attention. This year’s list is looking particularly good in my opinion!</p> <p><span style="text-decoration: underline;"><strong>Upcoming AWS and community events<br> </strong></span><a href="https://aws.amazon.com/events/public-sector-days/london/">AWS Public Sector Day London</a>, February 27 — Join public sector leaders and innovators to explore how AWS is enabling digital transformation in government, education, and healthcare.</p> <p><a href="https://aws.amazon.com/events/aws-innovate/">AWS Innovate GenAI + Data Edition</a> — A free online conference focusing on generative AI and data innovations. Available in multiple Regions: APJC and EMEA (March 6), North America (March 13), Greater China Region (March 14), and Latin America (April 8).</p> <p>Browse more upcoming&nbsp;<a href="https://aws.amazon.com/events/explore-aws-events/">AWS led in-person</a>&nbsp;and&nbsp;<a href="https://aws.amazon.com/developer/events/">virtual developer-focused events</a>.</p> <p>That’s it for this week! See you next time :)</p> <a href="https://www.linkedin.com/in/codingmatheus/">Matheus Guimaraes | @codingmatheus</a> AWS CodeBuild for macOS adds support for Fastlane https://aws.amazon.com/blogs/aws/codebuild-for-macos-adds-support-for-fastlane/ <![CDATA[Sébastien Stormacq]]> Wed, 05 Feb 2025 23:00:35 +0000 <![CDATA[Amazon EC2 Mac Instances]]> <![CDATA[Announcements]]> <![CDATA[AWS CodeBuild]]> <![CDATA[AWS Mobile Development]]> <![CDATA[Developer Tools]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> 45df78d6e1541d0e1dafd59a8eab514e9f34e36a AWS CodeBuild now includes pre-installed Fastlane in macOS environments, streamlining mobile app development by providing built-in access to automated tools for code signing, testing, and app distribution, without manual setup requirements. <p>I’m pleased to announce the availability of <a href="https://fastlane.tools/">Fastlane</a> in your <a href="https://aws.amazon.com/codebuild/">AWS CodeBuild</a> for macOS environments. AWS CodeBuild is a fully managed continuous integration service that compiles source code, runs tests, and produces ready-to-deploy software packages.</p> <p>Fastlane is an open source tool suite designed to automate various aspects of mobile application development. It provides mobile application developers with a centralized set of tools to manage tasks such as code signing, screenshot generation, beta distribution, and app store submissions. It integrates with popular continuous integration and continuous deployment (CI/CD) platforms and supports both iOS and Android development workflows. Although Fastlane offers significant automation capabilities, developers may encounter challenges during its setup and maintenance. Configuring Fastlane can be complex, particularly for teams unfamiliar with the syntax and package management system of Ruby. Keeping Fastlane and its dependencies up to date requires ongoing effort, because updates to mobile platforms or third-party services may necessitate adjustments to existing workflows.</p> <p>When <a href="https://aws.amazon.com/blogs/aws/add-macos-to-your-continuous-integration-pipelines-with-aws-codebuild/">we introduced CodeBuild for macOS in August 2024</a>, we knew that one of your challenges was to install and maintain Fastlane in your build environment. Although it was possible to manually install Fastlane in a custom build environment, at AWS, <a href="https://docs.aws.amazon.com/wellarchitected/latest/framework/cost-dp.html">we remove the undifferentiated heaving lifting from your infrastructure</a> so you can spend more time on the aspects that matter for your business. Starting today, Fastlane is installed by default, and you can use the familiar command <code>fastlane build</code>in your <code>buildspec.yaml</code> file.</p> <p><span style="text-decoration: underline;"><strong>Fastlane and code signing<br> </strong></span>To distribute an application on the App Store, developers must sign their binary with a private key generated on the Apple Developer portal. This private key, along with the certificate that validates it, must be accessible during the build process. This can be a challenge for development teams because they need to share the development private key (which allows deployment on selected test devices) among team members. Additionally, the distribution private key (which enables publishing on the App Store) must be available during the signing process before uploading the binary to the App Store.</p> <p>Fastlane is a versatile build system in that it also helps developers with the management of development and distribution keys and certificates. Developers can use <code>fastlane match</code> to share signing materials in a team and make them securely and easily accessible on individual developers’ machines and on the CI environment. <code>match</code> allows the storage of private keys, the certificates, and the mobile provisioning profiles on a secured share storage. It makes sure that the local build environment, whether it’s a developer laptop or a server machine in the cloud, stays in sync with the shared storage. At build time, it securely downloads the required certificates to sign your app and configures the build machine to allow the <code>codesign</code> utility to pick them up.</p> <p><code>match</code> allows the sharing of signing secrets through GitHub, GitLab, Google Cloud Storage, Azure DevOps, and <a href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (Amazon S3)</a>.</p> <p>If you already use one of these and you’re migrating your projects to CodeBuild, you don’t have much to do. You only need to make sure your CodeBuild build environment has access to the shared storage (see step 3 in the demo).</p> <p><span style="text-decoration: underline;"><strong>Let’s see how it works<br> </strong></span>If you’re new to Fastlane or CodeBuild, let’s see how it works.</p> <p>For this demo, I start with <a href="https://github.com/sebsto/amplify-ios-getting-started">an existing iOS project</a>. The project is already configured to be built on CodeBuild. You can refer to my previous blog post, <a href="https://aws.amazon.com/blogs/aws/add-macos-to-your-continuous-integration-pipelines-with-aws-codebuild/">Add macOS to your continuous integration pipelines with AWS CodeBuild</a>, to learn more details.</p> <p>I’ll show you how to get started in three steps:</p> <ul> <li>Import your existing signing materials to a shared private GitHub repository</li> <li>Configure <code>fastlane</code> to build and sign your project</li> <li>Use <code>fastlane</code>with CodeBuild</li> </ul> <p><strong>Step 1: Import your signing materials</strong></p> <p>Most of the <code>fastlane</code> <a href="https://docs.fastlane.tools/actions/match/">documentation</a> I read explains how to create a new key pair and a new certificate to get started. Although this is certainly true for new projects, in real life, you probably already have your project and your signing keys. So, the first step is to import these existing signing materials.</p> <p>Apple App Store uses different keys and certificates for development and distribution (there are also ad hoc and enterprise certificates, but these are outside the scope of this post). You must have three files for each usage (that’s a total of six files):</p> <ul> <li>A <code>.mobileprovision</code> file that you can create and download from the Apple developer console. The provisioning profile links your identity, the app identity, and the entitlements the app might have.</li> <li>A <code>.cer</code> file, which is the certificate emitted by Apple to validate your private key. You can download this from the <a href="https://developer.apple.com/account/resources/certificates/list">Apple Developer portal</a>. Select the certificate, then select <strong>Download</strong>.</li> <li>A <code>.p12</code> file, which contains your private key. You can download the key when you create it in the <a href="https://developer.apple.com/account/resources/certificates/add">Apple Developer portal</a>. If you didn’t download it but have it on your machine, you can export it from the Apple Keychain app. Note that the KeyChain.app is hidden in macOS 15.x. You can open it with <code>open /System/Library/CoreServices/Applications/Keychain\ Access.app</code>. Select the key you want to export and right click to select <strong>Export.</strong></li> </ul> <table> <tbody> <tr> <td><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/31/2025-01-31_17-16-05.png"><img loading="lazy" class="aligncenter size-large wp-image-93462" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/31/2025-01-31_17-16-05-1024x561.png" alt="Export p12 files from Keychain" width="1024" height="561"></a></td> <td><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/31/2025-01-31_17-17-53.png"><img loading="lazy" class="aligncenter size-full wp-image-93463" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/31/2025-01-31_17-17-53.png" alt="" width="1286" height="450"></a></td> </tr> </tbody> </table> <p>When you have these files, create a <code>fastlane/Matchfile</code> file with the following content:</p> <pre><code class="lang-ruby">git_url("https://github.com/sebsto/secret.git") storage_mode("git") type("development") # or use appstore to use the distribution signing key and certificate # type("appstore")</code></pre> <p>Be sure to replace the URL of your GitHub repository and <span style="color: #ff0000;"><strong>make sure this repository is private</strong></span>. It will serve as a storage for your signing key and certificate.</p> <p>Then, I import my existing files with the <code>fastlane match import --type appstore</code> command. I repeat the command for each environment: <code>appstore</code> and <code>development</code>.</p> <p>The very first time, <code>fastlane</code> prompts me for my Apple Id username and password. It connects to App Store Connect to verify the validity of the certificates or to create new ones when necessary. The session cookie is stored in <code>~/.fastlane/spaceship/&lt;your apple user id&gt;/cookie</code>.</p> <p><code>fastlane match</code> also asks for a password. It uses this password to generate a key to crypt the signing materials on the storage. Don’t forget this password because it will be used at build time to import the signing materials on the build machine.</p> <p>Here is the command and its output in full:</p> <pre><code class="lang-bash"> fastlane match import --type appstore [✔] 🚀 [16:43:54]: Successfully loaded '~/amplify-ios-getting-started/code/fastlane/Matchfile' 📄 +-----------------------------------------------------+ | Detected Values from './fastlane/Matchfile' | +--------------+--------------------------------------+ | git_url. | https://github.com/sebsto/secret.git | | storage_mode | git | | type | development | +--------------+--------------------------------------+ [16:43:54]: Certificate (.cer) path: ./secrets/sebsto-apple-dist.cer [16:44:07]: Private key (.p12) path: ./secrets/sebsto-apple-dist.p12 [16:44:12]: Provisioning profile (.mobileprovision or .provisionprofile) path or leave empty to skip this file: ./secrets/amplifyiosgettingstarteddist.mobileprovision [16:44:25]: Cloning remote git repo... [16:44:25]: If cloning the repo takes too long, you can use the `clone_branch_directly` option in match. [16:44:27]: Checking out branch master... [16:44:27]: Enter the passphrase that should be used to encrypt/decrypt your certificates [16:44:27]: This passphrase is specific per repository and will be stored in your local keychain [16:44:27]: Make sure to remember the password, as you'll need it when you run match on a different machine [16:44:27]: Passphrase for Match storage: ******** [16:44:30]: Type passphrase again: ******** security: SecKeychainAddInternetPassword &lt;NULL&gt;: The specified item already exists in the keychain. [16:44:31]: 🔓 Successfully decrypted certificates repo [16:44:31]: Repo is at: '/var/folders/14/nwpsn4b504gfp02_mrbyd2jr0000gr/T/d20250131-41830-z7b4ic' [16:44:31]: Login to App Store Connect ([email protected]) [16:44:33]: Enter the passphrase that should be used to encrypt/decrypt your certificates [16:44:33]: This passphrase is specific per repository and will be stored in your local keychain [16:44:33]: Make sure to remember the password, as you'll need it when you run match on a different machine [16:44:33]: Passphrase for Match storage: ******** [16:44:37]: Type passphrase again: ******** security: SecKeychainAddInternetPassword &lt;NULL&gt;: The specified item already exists in the keychain. [16:44:39]: 🔒 Successfully encrypted certificates repo [16:44:39]: Pushing changes to remote git repo... [16:44:40]: Finished uploading files to Git Repo [https://github.com/sebsto/secret.git] </code></pre> <p>I verify that Fastlane imported my signing material to my Git repository.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/31/2025-01-31_17-42-52.png"><img loading="lazy" class="aligncenter size-full wp-image-93464" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/31/2025-01-31_17-42-52.png" alt="Fastlane match - github repo after import" width="931" height="356"></a></p> <p>I can also configure my local machine to use these signing materials during the next build:</p> <pre><code class="lang-txt">» fastlane match appstore [✔] 🚀 [17:39:08]: Successfully loaded '~/amplify-ios-getting-started/code/fastlane/Matchfile' 📄 +-----------------------------------------------------+ | Detected Values from './fastlane/Matchfile' | +--------------+--------------------------------------+ | git_url | https://github.com/sebsto/secret.git | | storage_mode | git | | type | development | +--------------+--------------------------------------+ +-------------------------------------------------------------------------------------------+ | Summary for match 2.226.0 | +----------------------------------------+--------------------------------------------------+ | type | appstore | | readonly | false | | generate_apple_certs | true | | skip_provisioning_profiles | false | | app_identifier | ["com.amazonaws.amplify.mobile.getting-started"] | | username | xxxx@xxxxxxxxx | | team_id | XXXXXXXXXX | | storage_mode | git | | git_url | https://github.com/sebsto/secret.git | | git_branch | master | | shallow_clone | false | | clone_branch_directly | false | | skip_google_cloud_account_confirmation | false | | s3_skip_encryption | false | | gitlab_host | https://gitlab.com | | keychain_name | login.keychain | | force | false | | force_for_new_devices | false | | include_mac_in_profiles | false | | include_all_certificates | false | | force_for_new_certificates | false | | skip_confirmation | false | | safe_remove_certs | false | | skip_docs | false | | platform | ios | | derive_catalyst_app_identifier | false | | fail_on_name_taken | false | | skip_certificate_matching | false | | skip_set_partition_list | false | | force_legacy_encryption | false | | verbose | false | +----------------------------------------+--------------------------------------------------+ [17:39:08]: Cloning remote git repo... [17:39:08]: If cloning the repo takes too long, you can use the `clone_branch_directly` option in match. [17:39:10]: Checking out branch master... [17:39:10]: Enter the passphrase that should be used to encrypt/decrypt your certificates [17:39:10]: This passphrase is specific per repository and will be stored in your local keychain [17:39:10]: Make sure to remember the password, as you'll need it when you run match on a different machine [17:39:10]: Passphrase for Match storage: ******** [17:39:13]: Type passphrase again: ******** security: SecKeychainAddInternetPassword &lt;NULL&gt;: The specified item already exists in the keychain. [17:39:15]: 🔓 Successfully decrypted certificates repo [17:39:15]: Verifying that the certificate and profile are still valid on the Dev Portal... [17:39:17]: Installing certificate... +-------------------------------------------------------------------------+ | Installed Certificate | +-------------------+-----------------------------------------------------+ | User ID | XXXXXXXXXX | | Common Name | Apple Distribution: Sebastien Stormacq (XXXXXXXXXX) | | Organisation Unit | XXXXXXXXXX | | Organisation | Sebastien Stormacq | | Country | US | | Start Datetime | 2024-10-29 09:55:43 UTC | | End Datetime | 2025-10-29 09:55:42 UTC | +-------------------+-----------------------------------------------------+ [17:39:18]: Installing provisioning profile... +-------------------------------------------------------------------------------------------------------------------+ | Installed Provisioning Profile | +---------------------+----------------------------------------------+----------------------------------------------+ | Parameter | Environment Variable | Value | +---------------------+----------------------------------------------+----------------------------------------------+ | App Identifier | | com.amazonaws.amplify.mobile.getting-starte | | | | d | | Type | | appstore | | Platform | | ios | | Profile UUID | sigh_com.amazonaws.amplify.mobile.getting-s | 4e497882-d80f-4684-945a-8bfec1b310b9 | | | tarted_appstore | | | Profile Name | sigh_com.amazonaws.amplify.mobile.getting-s | amplify-ios-getting-started-dist | | | tarted_appstore_profile-name | | | Profile Path | sigh_com.amazonaws.amplify.mobile.getting-s | /Users/stormacq/Library/MobileDevice/Provis | | | tarted_appstore_profile-path | ioning | | | | Profiles/4e497882-d80f-4684-945a-8bfec1b310 | | | | b9.mobileprovision | | Development Team ID | sigh_com.amazonaws.amplify.mobile.getting-s | XXXXXXXXXX | | | tarted_appstore_team-id | | | Certificate Name | sigh_com.amazonaws.amplify.mobile.getting-s | Apple Distribution: Sebastien Stormacq | | | tarted_appstore_certificate-name | (XXXXXXXXXX) | +---------------------+----------------------------------------------+----------------------------------------------+ [17:39:18]: All required keys, certificates and provisioning profiles are installed 🙌</code></pre> <p><strong>Step 2: Configure Fastlane to sign your project</strong></p> <p>I create a Fastlane build configuration file in <code>fastlane/Fastfile</code> (you can use <code>fastlane init</code> command to get started):</p> <pre><code class="lang-ruby">default_platform(:ios) platform :ios do before_all do setup_ci end desc "Build and Sign the binary" lane :build do match(type: "appstore", readonly: true) gym( scheme: "getting started", export_method: "app-store" ) end end </code></pre> <p>Make sure that the <code>setup_ci</code> action is added to the <code>before_all</code> section of <code>Fastfile</code> for the <code>match</code> action to function correctly. This action creates a temporary Fastlane keychain with correct permissions. Without this step, you may encounter build failures or inconsistent results.</p> <p>And I test a local build with the command <code>fastlane build</code>. I enter the password I used when importing my keys and certificate, then I let the system build and sign my project. When everything is correctly configured, it produces a similar output.</p> <pre><code class="lang-txt">... [17:58:33]: Successfully exported and compressed dSYM file [17:58:33]: Successfully exported and signed the ipa file: [17:58:33]: ~/amplify-ios-getting-started/code/getting started.ipa +---------------------------------------+ | fastlane summary | +------+------------------+-------------+ | Step | Action | Time (in s) | +------+------------------+-------------+ | 1 | default_platform | 0 | | 2 | setup_ci | 0 | | 3 | match | 36 | | 4 | gym | 151 | +------+------------------+-------------+ [17:58:33]: fastlane.tools finished successfully 🎉</code></pre> <p><strong>Step 3: Configure CodeBuild to use Fastlane</strong></p> <p>Next, I create a project on CodeBuild. I’m not going into the step-by-step guide to help you to do so. You can refer to <a href="https://aws.amazon.com/blogs/aws/add-macos-to-your-continuous-integration-pipelines-with-aws-codebuild/">my previous post</a> or to <a href="https://docs.aws.amazon.com/codebuild/latest/userguide/fleets.html#fleets.configure-macos">the CodeBuild documentation</a>.</p> <p>There is just one Fastlane-specific configuration. To access the signing materials, Fastlane requires access to three secret values that I’ll pass as environment variables:</p> <ul> <li><code>MATCH_PASSWORD</code>, the password I entered when importing the signing material. Fastlane uses this password to decipher the encrypted files in the GitHub repository</li> <li><code>FASTLANE_SESSION</code>, the value of the Apple Id session cookie, located at <code>~/.fastlane/spaceship/&lt;your apple user id&gt;/cookie</code>. The session is valid from a couple of hours to multiple days. When the session expires, reauthenticate with the command <code>fastlane spaceauth</code> from your laptop and update the value of <code>FASTLANE_SESSION</code> with the new value of the cookie.</li> <li><code>MATCH_GIT_BASIC_AUTHORIZATION</code>, a base 64 encoding of your GitHub username, followed by a colon, followed by a personal authentication token (PAT) to access your private GitHub repository. You can generate PAT on <a href="https://github.com/settings/personal-access-tokens">the GitHub console</a> in Your Profile &gt; Settings &gt; Developers Settings &gt; Personal Access Token. I use this command to generate the value of this environment variable: <code>echo -n my_git_username:my_git_pat | base64</code>.</li> </ul> <p>Note that for each of these three values, I can enter the Amazon Resource Name (ARN) of the secret on <a href="https://aws.amazon.com/secrets-manager/">AWS Secrets Manager</a> or the plain text value. We strongly <a href="https://docs.aws.amazon.com/codebuild/latest/userguide/build-spec-ref.html#build-spec.env.secrets-manager">recommend using Secrets Manager to store security-sensitive values</a>.</p> <p>I’m a security-conscious user, so I store the three secrets in Secrets Manager with these commands:</p> <p><code class="lang-sh">aws --region $REGION secretsmanager create-secret --name /CodeBuild/MATCH_PASSWORD --secret-string MySuperSecretPassword<br> aws --region $REGION secretsmanager create-secret --name /CodeBuild/FASTLANE_SESSION --secret-string $(cat ~/.fastlane/spaceship/my_appleid_username/cookie)<br> aws --region $REGION secretsmanager create-secret --name /CodeBuild/MATCH_GIT_BASIC_AUTHORIZATION --secret-string $(echo -n my_git_username:my_git_pat | base64)<br> </code></p> <p>If your build project refers to secrets stored in Secrets Manager, the build project’s service role must allow the&nbsp;<code>secretsmanager:GetSecretValue</code> action. If you chose <strong>New service role</strong> when you created your project, CodeBuild includes this action in the default service role for your build project. However, if you chose <strong>Existing service role</strong>, you must include this action to your service role separately.</p> <p>For this demo, I use this <a href="https://aws.amazon.com/iam/">AWS Identity and Access Management (IAM)</a> policy:</p> <pre><code class="lang-json">{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "secretsmanager:GetSecretValue" ], "Resource": [ "arn:aws:secretsmanager:us-east-2:012345678912:secret:/CodeBuild/*" ] } ] }</code></pre> <p>After I created the project in the CodeBuild section of the <a href="https://console.aws.amazon.com">AWS Management Console</a>, I enter the three environment variables. Notice that the value is the name of the secret in Secrets Manager.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/03/2025-02-03_18-20-53.png"><img loading="lazy" class="aligncenter wp-image-93498 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/03/2025-02-03_18-20-53.png" alt="Codebuild - environment variables for Fastlane match" width="719" height="272"></a></p> <p>You can also define the environment variables and their Secrets Manager secret name in your <code>buildpsec.yaml</code>&nbsp;file.</p> <p>Next, I modify the <code>buildspec.yaml</code> file at the root of my project to use <code>fastlane</code> to build and sign the binary. My <code>buildspec.yaml</code> file now looks like this one:</p> <pre><code class="lang-yaml"># buildspec.yml version: 0.2 phases: install: commands: - code/ci_actions/00_install_rosetta.sh pre_build: commands: - code/ci_actions/02_amplify.sh build: commands: - (cd code &amp;&amp; fastlane build) artifacts: name: getting-started-$(date +%Y-%m-%d).ipa files: - 'getting started.ipa' base-directory: 'code'</code></pre> <p>The Rosetta and Amplify scripts are required to receive the Amplify configuration for the backend. If you don’t use <a href="https://aws-amplify.github.io/">AWS Amplify</a> in your project, you don’t need these.</p> <p>Notice that there is nothing in the build file that downloads the signing key or prepares the keychain in the build environment; <code>fastlane match</code> will do that for me.</p> <p>I add the new <code>buildspec.yaml</code> file and my <code>./fastlane</code>&nbsp;directory to Git. I commit and push these files. <code>git commit -m "add fastlane support" &amp;&amp; git push</code></p> <p>When everything goes well, I can see the build running on CodeBuild and the <span style="color: #339966;"><strong>Succeeded</strong></span> message.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/04/2025-02-04_09-25-46.png"><img loading="lazy" class="aligncenter wp-image-93507" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/04/2025-02-04_09-25-46-1024x655.png" alt="Codebuild - succeed message" width="800" height="512"></a></p> <p><strong><span style="text-decoration: underline;">Pricing and availability</span><br> </strong>Fastlane is now pre-installed at no extra cost on all macOS images that CodeBuild uses, in all <a href="https://docs.aws.amazon.com/glossary/latest/reference/glos-chap.html#region">Regions</a> where CodeBuild for macOS is available. At the time of this writing, these are US East (Ohio, N. Virginia), US West (Oregon), Asia Pacific (Sydney), and Europe (Frankfurt).</p> <p>In my experience, it takes a bit of time to configure <code>fastlane match</code> correctly. When it’s configured, having it working on CodeBuild is pretty straightforward. Before trying this on CodeBuild, be sure it works on your local machine. When something goes wrong on CodeBuild, triple-check the values of the environment variables and make sure CodeBuild has access to your secrets on AWS Secrets Manager.</p> <p>Now go build (on macOS)!</p> AWS Weekly Roundup: DeepSeek-R1, S3 Metadata, Elastic Beanstalk updates, and more (February 3, 2024) https://aws.amazon.com/blogs/aws/aws-weekly-roundup-deepseek-r1-s3-metadata-elastic-beanstalk-updates-and-more-february-3-2024/ <![CDATA[Donnie Prakoso]]> Mon, 03 Feb 2025 18:43:16 +0000 <![CDATA[Amazon Bedrock]]> <![CDATA[Amazon SageMaker]]> <![CDATA[Amazon Simple Storage Service (S3)]]> <![CDATA[Announcements]]> <![CDATA[Artificial Intelligence]]> <![CDATA[AWS Amplify]]> <![CDATA[AWS Elastic Beanstalk]]> <![CDATA[Compute]]> <![CDATA[Front-End Web & Mobile]]> <![CDATA[Generative AI]]> <![CDATA[Launch]]> <![CDATA[News]]> <![CDATA[Week in Review]]> 9767a7610b3a3be92918cae47f5c700e5dd0e86e Last week, I had an amazing time attending AWS Community Day Thailand in Bangkok. This event came at an exciting time, following the recent launch of the AWS Asia Pacific (Bangkok) Region. We had over 300 attendees and featured 15 speakers from the community, including an AWS Hero and 4 AWS Community Builders who shared […] <p>Last week, I had an amazing time attending <a href="https://www.eventpop.me/e/70681/aws-community-day-2025">AWS Community Day Thailand</a> in Bangkok. This event came at an exciting time, following the recent launch of the <a href="https://aws.amazon.com/blogs/aws/announcing-the-new-aws-asia-pacific-thailand-region/">AWS Asia Pacific (Bangkok) Region</a>. We had over 300 attendees and featured 15 speakers from the community, including an AWS Hero and 4 AWS Community Builders who shared their technical expertise and experiences.</p> <p>The highlight was definitely <a href="https://www.linkedin.com/in/jeffbarr/">Jeff Barr</a>, AWS Vice President &amp; Chief Evangelist, delivering an inspiring keynote titled “Next-Generation Software Development”, which set the perfect tone for the day. The day kicked off with welcoming remarks from <a href="https://www.linkedin.com/in/vatsunthirapatarapong/">Vatsun Thirapatarapong</a>, AWS Country Manager for Thailand, and was made even more special thanks to the tremendous support from both the AWS User Group volunteers and the AWS Thailand team.</p> <p>Here’s a photo capturing the excitement from the event:&nbsp;</p> <p><img loading="lazy" class="aligncenter size-large wp-image-93493" style="border: 1px solid black; padding: 3px;" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/03/AWS-Community-TH-2025-1430-1024x576.jpg" alt="" width="1024" height="576"></p> <p><span style="text-decoration: underline;"><strong>Last week’s AWS Launches</strong></span> <br>There are 30+ launches last week and here are some launches that caught my attention:</p> <p><a href="https://aws.amazon.com/blogs/aws/deepseek-r1-models-now-available-on-aws/">DeepSeek-R1 models now available on AWS</a> — Channy wrote on how you can now deploy DeepSeek-R1 models in&nbsp;<a href="https://aws.amazon.com/bedrock/">Amazon Bedrock</a>&nbsp;and&nbsp;<a href="https://aws.amazon.com/sagemaker-ai/">Amazon SageMaker AI</a>. This helps you to build and scale generative AI applications with minimal infrastructure investment.</p> <p><img loading="lazy" class="aligncenter size-full" style="border: 1px solid black; padding: 3px;" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/30/2025-deepseek-r1-on-aws-3-bedrock-marketplace.png" width="2365" height="1022"></p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-s3-tables-10000-tables-bucket/">Amazon S3 Tables increases table limit to 10,000 per bucket</a> — S3 Tables now supports creating up to 10,000 tables in each table bucket, allowing you to scale up to 100,000 tables across 10 buckets within an AWS Region per account.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-s3-metadata-generally-available/">Amazon S3 Metadata now generally available</a> — S3 Metadata provides automated and easily queried metadata that updates in near real-time, simplifying business analytics and real-time inference applications. It supports both system-defined and custom metadata, including integration with AWS analytics services.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-amplify-typescript-data-client-server-side-lambda/">AWS Amplify adds TypeScript Data client support for Lambda functions</a> — Developers can now use the Amplify Data client within <a href="https://aws.amazon.com/lambda/">AWS Lambda</a> functions, enabling consistent type-safe data operations across frontend and backend applications.</p> <p><a href="https://aws.amazon.com/elasticbeanstalk/">AWS Elastic Beanstalk</a> adds <a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-elastic-beanstalk-python-3-13-amazon-linux-2023/">Python 3.13</a>, <a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-elastic-beanstalk-net-9-amazon-linux-2023/">.NET 9</a>, and <a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-elastic-beanstalk-php-8-4-amazon-linux-2023/">PHP 8.4</a> support on Amazon Linux 2023 — AWS Elastic Beanstalk brings the latest language features and improvements to application deployments while benefiting from Amazon Linux 2023 enhanced security and performance features.</p> <p><span style="text-decoration: underline;"><strong>From community.aws</strong></span> <br>Here’s my top 5 personal favorites posts from <a href="https://community.aws/">community.aws</a>:</p> <ul> <li><a href="https://community.aws/content/2sECf0xbpgEIaUpAJcwbrSnIGfu/deploying-deepseek-r1-model-on-amazon-bedrock?trk=929bca63-e742-46be-aad8-f9c833d80096&amp;sc_channel=el">Deploying DeepSeek-R1 Distill Llama Models on Amazon Bedrock</a> by Manu Mishra</li> <li><a href="https://community.aws/content/2rUWv51ucV5quMLSHP9CsFEscQJ/building-tile-slide?trk=929bca63-e742-46be-aad8-f9c833d80096&amp;sc_channel=el">Building Tile Slide</a> by Yash</li> <li><a href="https://community.aws/content/2qwrWIoHLjZKOuLeZPbEpfi1l5K/farm-build-fight-the-survival-rpg-you-never-knew-you-need?trk=929bca63-e742-46be-aad8-f9c833d80096&amp;sc_channel=el">Farm, Build, Fight! The survival RPG you never knew you needed</a> by AgentOk</li> <li><a href="https://community.aws/content/2sRLHR0RQ7AjOkCauJmQhoYzipL/pep-and-pdp-for-secure-authorization-with-cognito?trk=929bca63-e742-46be-aad8-f9c833d80096&amp;sc_channel=el">PEP and PDP for Secure Authorization with Cognito</a> by Jimmy Dahlqvist</li> <li><a href="https://community.aws/content/2rfzwQcf4Z8Jb7EQRlgRMJ8eltx/q-bits-simplifying-vpc-configuration-setup-with-cloudformation-using-amazon-q-developer?trk=929bca63-e742-46be-aad8-f9c833d80096&amp;sc_channel=el">Q-Bits: Simplifying VPC configurations setup with AWS CloudFormation using Amazon Q Developer</a> by Suruchi Saxena</li> </ul> <p><span style="text-decoration: underline;"><strong>Upcoming AWS and community events</strong></span> <br>Check your calendars and sign up for upcoming AWS and community events:</p> <ul> <li><a href="https://pages.awscloud.com/aws-reinvent-recap-korea-reg.html">AWS Korea re:Invent reCap Online</a>, February 2-4 — A virtual event recapping key announcements and innovations from re:Invent 2023 for the Korean audience.</li> <li><a href="https://aws.amazon.com/events/community-day/?developer-center-activities-cards.sort-by=item.additionalFields.startDateTime&amp;developer-center-activities-cards.sort-order=asc">AWS Community Days</a> – Join community-led conferences that feature technical discussions, workshops, and hands-on labs. Upcoming AWS Community Day is in <a href="https://awsahmedabad.community/">Ahmedabad</a> (February 8).</li> <li><a href="https://aws.amazon.com/events/public-sector-days/london/">AWS Public Sector Day London</a>, February 27 — Join public sector leaders and innovators to explore how AWS is enabling digital transformation in government, education, and healthcare.</li> <li><a href="https://aws.amazon.com/events/aws-innovate/">AWS Innovate GenAI + Data Edition</a> — A free online conference focusing on generative AI and data innovations. Available in multiple Regions: APJC and EMEA (March 6), North America (March 13), Greater China Region (March 14), and Latin America (April 8).</li> </ul> <p>Browse more upcoming <a href="https://aws.amazon.com/events/explore-aws-events/">AWS led in-person</a> and <a href="https://aws.amazon.com/developer/events/">virtual developer-focused events</a>.</p> <p><img loading="lazy" class="alignright wp-image-93484 size-medium" style="border: 1px solid black; padding: 3px;" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/03/2025-wir-reinventrecap-300x169.png" alt="" width="300" height="169"></p> <p><strong><span style="text-decoration: underline;">AWS Community re:Invent re:Caps</span><br></strong></p> <p>Lastly, if you want to learn about top announcements and innovations from AWS re:Invent, the AWS Community shares a summary from a community perspective of these announcements so you can get up to speed. Download the <a href="https://community.aws/recaps?trk=929bca63-e742-46be-aad8-f9c833d80096&amp;sc_channel=el&amp;postLogin=downloadPDF">AWS Community re:Invent re:Caps deck</a>.&nbsp;</p> <p>That’s all for this week. Check back next Monday for another Weekly Roundup!</p> <p>— <a href="https://linkedin.com/in/donnieprakoso">Donnie</a></p> <p><em>This post is part of our <a href="https://aws.amazon.com/blogs/aws/tag/week-in-review/">Weekly Roundup</a> series. Check back each week for a quick roundup of interesting news and announcements from AWS!</em></p> DeepSeek-R1 models now available on AWS https://aws.amazon.com/blogs/aws/deepseek-r1-models-now-available-on-aws/ <![CDATA[Channy Yun (윤석찬)]]> Fri, 31 Jan 2025 00:00:40 +0000 <![CDATA[Amazon Bedrock]]> <![CDATA[Amazon Machine Learning]]> <![CDATA[Amazon SageMaker]]> <![CDATA[Amazon SageMaker AI]]> <![CDATA[Announcements]]> <![CDATA[Artificial Intelligence]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> aee830b8f693633d45f93d5b3c09221ed0063b61 DeepSeek-R1, a powerful large language model featuring reinforcement learning and chain-of-thought capabilities, is now available for deployment via Amazon Bedrock and Amazon SageMaker AI, enabling users to build and scale their generative AI applications with minimal infrastructure investment to meet diverse business needs. <p><em><strong>Updated on February 5, 2025</strong>&nbsp;— DeepSeek-R1 Distill Llama and Qwen models are now available in Amazon Bedrock Marketplace and Amazon SageMaker JumpStart.</em></p> <p>During this past AWS re:Invent, Amazon CEO Andy Jassy <a href="https://youtu.be/LY7m5LQliAo?feature=shared&amp;t=6291">shared valuable lessons learned</a> from Amazon’s own experience developing nearly 1,000 <a href="https://aws.amazon.com/ai/generative-ai/">generative AI</a> applications across the company. Drawing from this extensive scale of AI deployment, Jassy offered three key observations that have shaped Amazon’s approach to enterprise AI implementation.</p> <blockquote> <p>First is that as you get to scale in generative AI applications, the cost of compute really matters. People are very hungry for better price performance. The second is actually quite difficult to build a really good generative AI application. The third is the diversity of the models being used when we gave our builders freedom to pick what they want to do. It doesn’t surprise us, because we keep learning the same lesson over and over and over again, which is that there is never going to be one tool to rule the world.</p> </blockquote> <p><img loading="lazy" class="aligncenter size-full wp-image-93427" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/30/2025-deepseek-r1-on-aws-1-andy-keynote.png" alt="" width="1080" height="496"></p> <p>As Andy emphasized, a broad and deep range of models provided by Amazon empowers customers to choose the precise capabilities that best serve their unique needs. By closely monitoring both customer needs and technological advancements, AWS regularly expands our curated selection of models to include promising new models alongside established industry favorites. This ongoing expansion of high-performing and differentiated model offerings helps customers stay at the forefront of AI innovation.</p> <p>This leads us to Chinese AI startup <a href="https://www.deepseek.com/">DeepSeek</a>. DeepSeek launched <a href="https://github.com/deepseek-ai/DeepSeek-V3">DeepSeek-V3</a> on December 2024 and subsequently released <a href="https://github.com/deepseek-ai/DeepSeek-R1">DeepSeek-R1</a>, DeepSeek-R1-Zero with 671 billion parameters, and DeepSeek-R1-Distill models ranging from 1.5–70 billion parameters on January 20, 2025. They added their vision-based <a href="https://github.com/deepseek-ai/Janus">Janus-Pro-7B</a> model on January 27, 2025. The models are publicly available and are <a href="https://venturebeat.com/ai/open-source-deepseek-r1-uses-pure-reinforcement-learning-to-match-openai-o1-at-95-less-cost/">reportedly 90-95% more affordable and cost-effective than comparable models</a>. Per Deepseek, their model stands out for its reasoning capabilities, achieved through innovative training techniques such as reinforcement learning.</p> <p><strong>Today, you can now deploy DeepSeek-R1 models in <a href="https://aws.amazon.com/bedrock/">Amazon Bedrock</a> and <a href="https://aws.amazon.com/sagemaker-ai/">Amazon SageMaker AI</a></strong>. Amazon Bedrock is best for teams seeking to quickly integrate pre-trained foundation models through APIs. Amazon SageMaker AI is ideal for organizations that want advanced customization, training, and deployment, with access to the underlying infrastructure. Additionally, you can also use <a href="https://aws.amazon.com/ai/machine-learning/trainium/">AWS Trainium</a> and <a href="https://aws.amazon.com/ai/machine-learning/inferentia/">AWS Inferentia</a> to deploy DeepSeek-R1-Distill models cost-effectively via <a href="https://aws.amazon.com/ec2/">Amazon Elastic Compute Cloud (Amazon EC2)</a> or Amazon SageMaker AI.</p> <p>With AWS, you can use DeepSeek-R1 models to build, experiment, and responsibly scale your generative AI ideas by using this powerful, cost-efficient model with minimal infrastructure investment. You can also confidently drive generative AI innovation by building on AWS services that are uniquely designed for security. We highly recommend integrating your deployments of the DeepSeek-R1 models with <a href="https://aws.amazon.com/bedrock/guardrails/">Amazon Bedrock Guardrails</a> to add a layer of protection for your generative AI applications, which can be used by both Amazon Bedrock and Amazon SageMaker AI customers.</p> <p>You can choose how to deploy DeepSeek-R1 models on AWS today in a few ways: <strong>1/ <a href="https://aws.amazon.com/bedrock/marketplace/">Amazon Bedrock Marketplace</a> for the DeepSeek-R1 model</strong>, <strong>2/ <a href="https://aws.amazon.com/sagemaker/jumpstart/">Amazon SageMaker JumpStart</a> for the DeepSeek-R1 model</strong>, <strong>3/ <a href="https://aws.amazon.com/bedrock/custom-model-import/">Amazon Bedrock Cust</a><a href="https://aws.amazon.com/bedrock/custom-model-import/">om Model Import</a> for the DeepSeek-R1-Distill models</strong>, and <strong>4/ <a href="https://aws.amazon.com/ec2/instance-types/trn1/">Amazon EC2 Trn1 instances</a> for the DeepSeek-R1-Distill models</strong>.</p> <p>Let me walk you through the various paths for getting started with DeepSeek-R1 models on AWS. Whether you’re building your first AI application or scaling existing solutions, these methods provide flexible starting points based on your team’s expertise and requirements.</p> <p><b><u>1. The DeepSeek-R1 model in Amazon Bedrock Marketplace</u></b><br> <a href="https://aws.amazon.com/bedrock/marketplace/">Amazon Bedrock Marketplace</a> offers over 100 popular, emerging, and specialized FMs alongside the current selection of industry-leading models in Amazon Bedrock. You can easily discover models in a single catalog, subscribe to the model, and then deploy the model on managed endpoints.</p> <p>To access the DeepSeek-R1 model in Amazon Bedrock Marketplace, go to the <a href="https://console.aws.amazon.com/bedrock/home?#/model-catalog">Amazon Bedrock console</a> and select <b>Model catalog</b> under the <b>Foundation models </b>section. You can quickly find DeepSeek by searching or filtering by model providers.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93436" style="width: 100%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/30/2025-deepseek-r1-on-aws-3-bedrock-marketplace.png" alt="" width="2365" height="1022"></p> <p>After checking out the model detail page including the model’s capabilities, and implementation guidelines, you can directly deploy the model by providing an endpoint name, choosing the number of instances, and selecting an instance type.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93437" style="width: 100%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/30/2025-deepseek-r1-on-aws-3-bedrock-marketplace-deploy.png" alt="" width="2154" height="1201"></p> <p>You can also configure advanced options that let you customize the security and infrastructure settings for the DeepSeek-R1 model including VPC networking, service role permissions, and encryption settings. For production deployments, you should review these settings to align with your organization’s security and compliance requirements.</p> <p>With Amazon Bedrock Guardrails, you can independently evaluate user inputs and model outputs. You can control the interaction between users and DeepSeek-R1 with your defined set of policies by filtering undesirable and harmful content in generative AI applications. The DeepSeek-R1 model in Amazon Bedrock Marketplace can only be used with Bedrock’s <a href="https://aws.amazon.com/blogs/aws/guardrails-for-amazon-bedrock-can-now-detect-hallucinations-and-safeguard-apps-built-using-custom-or-third-party-fms/" target="_blank" rel="noopener">ApplyGuardrail API</a> to evaluate user inputs and model responses for custom and third-party FMs available outside of Amazon Bedrock. To learn more, read <a href="https://aws.amazon.com/blogs/machine-learning/implement-model-independent-safety-measures-with-amazon-bedrock-guardrails/">Implement model-independent safety measures with Amazon Bedrock Guardrails</a>.</p> <p>Amazon Bedrock Guardrails can also be integrated with other Bedrock tools including <a href="https://aws.amazon.com/bedrock/agents/">Amazon Bedrock Agents</a> and <a href="https://aws.amazon.com/bedrock/knowledge-bases/">Amazon Bedrock Knowledge Bases</a> to build safer and more secure generative AI applications aligned with responsible AI policies. To learn more, visit the <a href="https://aws.amazon.com/ai/responsible-ai/">AWS Responsible AI</a> page.</p> <p><strong>Updated on 1st February</strong> – You can use the Bedrock playground for understanding how the model responds to various inputs and letting you fine-tune your prompts for optimal results.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93477" style="width: 90%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/02/bedrock-marketplace-playground-1.png" alt="" width="2034" height="1375"></p> <p>When using DeepSeek-R1 model with the Bedrock’s playground or <code>InvokeModel</code> API, please use DeepSeek’s chat template for optimal results. For example, <code>&lt;｜begin_of_sentence｜&gt;&lt;｜User｜&gt;content for inference&lt;｜Assistant｜&gt;</code>.</p> <p>Refer to this <a href="https://aws.amazon.com/blogs/machine-learning/deepseek-r1-model-now-available-in-amazon-bedrock-marketplace-and-amazon-sagemaker-jumpstart/">step-by-step guide</a> on how to deploy the DeepSeek-R1 model in Amazon Bedrock Marketplace. To learn more, visit <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/amazon-bedrock-marketplace.html">Deploy models in Amazon Bedrock Marketplace</a>.</p> <p><b><u>2. The DeepSeek-R1 model in Amazon SageMaker JumpStart</u></b><br> <a href="https://aws.amazon.com/sagemaker-ai/jumpstart/">Amazon SageMaker JumpStart</a> is a machine learning (ML) hub with FMs, built-in algorithms, and prebuilt ML solutions that you can deploy with just a few clicks. To deploy DeepSeek-R1 in SageMaker JumpStart, you can discover the DeepSeek-R1 model in <a href="https://aws.amazon.com/sagemaker/unified-studio/">SageMaker Unified Studio</a>, <a href="https://aws.amazon.com/sagemaker-ai/studio/">SageMaker Studio</a>, <a href="https://us-east-1.console.aws.amazon.com/sagemaker/home?#/foundation-models">SageMaker AI console</a>, or programmatically through the <a href="https://sagemaker.readthedocs.io/en/stable/overview.html">SageMaker Python SDK</a>.</p> <p>In the <a href="https://console.aws.amazon.com/sagemaker/">Amazon SageMaker AI console</a>, open SageMaker Studio and choose <b>JumpStart</b> and search for “<code>DeepSeek-R1</code>” in the <b>All public models</b> page.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93438" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/30/2025-deepseek-r1-on-aws-5-sagemaker-jumpstart.png" alt="" width="2585" height="1735"></p> <p>You can select the model and choose deploy to create an endpoint with default settings. When the endpoint comes <b>InService</b>, you can make inferences by sending requests to its endpoint.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93439" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/30/2025-deepseek-r1-on-aws-6-sagemaker-jumpstart-deploy.png" alt="" width="2441" height="1736"></p> <p>You can derive model performance and ML operations controls with <a href="https://aws.amazon.com/sagemaker/">Amazon SageMaker AI</a> features such as <a href="https://aws.amazon.com/sagemaker/pipelines/">Amazon SageMaker Pipelines</a>, <a href="https://docs.aws.amazon.com/sagemaker/latest/dg/train-debugger.html">Amazon SageMaker Debugger</a>, or container logs. The model is deployed in an AWS secure environment and under your virtual private cloud (VPC) controls, helping to support data security.</p> <p>As like Bedrock Marketpalce, you can use the <code>ApplyGuardrail</code> API in the SageMaker JumpStart to decouple safeguards for your generative AI applications from the DeepSeek-R1 model. You can now use guardrails without invoking FMs, which opens the door to more integration of standardized and thoroughly tested enterprise safeguards to your application flow regardless of the models used.</p> <p>Refer to this <a href="https://aws.amazon.com/blogs/machine-learning/deepseek-r1-model-now-available-in-amazon-bedrock-marketplace-and-amazon-sagemaker-jumpstart/">step-by-step guide</a> on how to deploy the DeepSeek-R1 model in Amazon SageMaker JumpStart. To learn more, visit <a href="https://docs.aws.amazon.com/sagemaker-unified-studio/latest/userguide/sagemaker-discover-models.html">Discover SageMaker JumpStart models in SageMaker Unified Studio</a> or <a href="https://docs.aws.amazon.com/sagemaker/latest/dg/jumpstart-foundation-models-use-studio-updated-deploy.html">Deploy SageMaker JumpStart models in SageMaker Studio</a>.</p> <p><b><u>3. DeepSeek-R1-Distill models using Amazon Bedrock Custom Model Import</u></b><br> <a href="https://aws.amazon.com/bedrock/custom-model-import/">Amazon Bedrock Custom Model Import</a> provides the ability to import and use your customized models alongside existing FMs through a single serverless, unified API without the need to manage underlying infrastructure. With Amazon Bedrock Custom Model Import, you can import <a href="https://huggingface.co/collections/deepseek-ai/deepseek-r1-678e1e131c0169c0bc89728d">DeepSeek-R1-Distill models</a> ranging from 1.5–70 billion parameters. As I highlighted in <a href="https://aws.amazon.com/blogs/aws/build-faster-more-cost-efficient-highly-accurate-models-with-amazon-bedrock-model-distillation-preview/">my blog post about Amazon Bedrock Model Distillation</a>, the distillation process involves training smaller, more efficient models to mimic the behavior and reasoning patterns of the larger DeepSeek-R1 model with 671 billion parameters by using it as a teacher model.</p> <p>After storing these publicly available models in an <a href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (Amazon S3)</a> bucket or an <a href="https://docs.aws.amazon.com/sagemaker/latest/dg/model-registry.html">Amazon SageMaker Model Registry</a>, go to <b>Imported models</b> under <b>Foundation models</b> in the <a href="https://console.aws.amazon.com/bedrock/home?#/model-catalog">Amazon Bedrock console</a> and import and deploy them in a fully managed and serverless environment through Amazon Bedrock. This serverless approach eliminates the need for infrastructure management while providing enterprise-grade security and scalability.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93428" style="width: 100%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/30/2025-deepseek-r1-on-aws-4-bedrock-custom-model-import.png" alt="" width="2424" height="887"></p> <p><strong>Updated on 1st February</strong> – After importing the distilled model, you can use the Bedrock playground for understanding distilled model responses for your inputs.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93479" style="width: 90%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/02/02/bedrock-customer-model-import-playground-1.jpg" alt="" width="1887" height="1182"></p> <p>Watch a <a href="https://www.youtube.com/watch?v=1aq_ju70qHQ">demo video</a> made by my colleague <a href="https://www.linkedin.com/in/duanlightfoot/">Du’An Lightfoot</a> for importing the model and inference in the Bedrock playground.</p> <p><iframe loading="lazy" title="Deploy DeepSeek-R1 models with Amazon Bedrock Custom Model Import | Amazon Web Services" width="500" height="281" src="https://www.youtube-nocookie.com/embed/1aq_ju70qHQ?feature=oembed" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen sandbox="allow-scripts allow-same-origin"></iframe></p> <p>Refer to this <a href="https://aws.amazon.com/blogs/machine-learning/deploy-deepseek-r1-distilled-llama-models-with-amazon-bedrock-custom-model-import/">step-by-step guide</a> on how to deploy DeepSeek-R1-Distill models using Amazon Bedrock Custom Model Import. To learn more, visit <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/model-customization-import-model.html">Import a customized model into Amazon Bedrock</a>.</p> <p><b><u>4. DeepSeek-R1-Distill models using AWS Trainium and AWS Inferentia</u></b><br> <a href="https://docs.aws.amazon.com/dlami/latest/devguide/getting-started.html">AWS Deep Learning AMIs (DLAMI)</a> provides customized machine images that you can use for deep learning in a variety of Amazon EC2 instances, from a small CPU-only instance to the latest high-powered multi-GPU instances. You can deploy the DeepSeek-R1-Distill models on AWS Trainuim1 or AWS Inferentia2 instances to get the best price-performance.</p> <p>To get started, go to <a href="https://quip-amazon.com/atboAwqWK1fT/console.aws.amazon.com/ec2">Amazon EC2 console</a> and launch a <code>trn1.32xlarge</code> EC2 instance with the <a href="https://awsdocs-neuron.readthedocs-hosted.com/en/latest/dlami/index.html">Neuron Multi Framework DLAMI </a>called Deep Learning AMI Neuron (Ubuntu 22.04).</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93429" style="width: 100%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/30/2025-deepseek-r1-on-aws-7-ec2-instance.png" alt="" width="2394" height="1504"></p> <p>Once you have connected to your launched ec2 instance, install vLLM, an open-source tool to serve <a href="https://aws.amazon.com/what-is/large-language-model/">Large Language Models (LLMs)</a> and download the DeepSeek-R1-Distill model from Hugging Face. You can deploy the model using vLLM and invoke the model server.</p> <p>To learn more, refer to this <a href="https://repost.aws/articles/ARDaRTyEVQR9iWfVdek2CQwg/get-started-with-deepseek-r1-on-aws-inferentia-and-trainium">step-by-step guide</a> on how to deploy DeepSeek-R1-Distill Llama models on AWS Inferentia and Trainium.</p> <p>You can also visit <a href="https://huggingface.co/collections/deepseek-ai/deepseek-r1-678e1e131c0169c0bc89728d">DeepSeek-R1-Distill models cards</a> on Hugging Face, such as <a href="https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B">DeepSeek-R1-Distill-Llama-8B</a> or <a href="https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-70B">deepseek-ai/DeepSeek-R1-Distill-Llama-70B</a>. Choose <b>Deploy</b> and then <b>Amazon SageMaker</b>. From the <b>AWS Inferentia and Trainium</b> tab, copy the example code for deploy DeepSeek-R1-Distill models.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93430" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/30/2025-deepseek-r1-on-aws-8-hugging-face.png" alt="" width="1974" height="1354"></p> <p>Since the release of DeepSeek-R1, various guides of its deployment for Amazon EC2 and <a href="https://aws.amazon.com/eks/">Amazon Elastic Kubernetes Service (Amazon EKS)</a> have been posted. Here is some additional material for you to check out:</p> <ul> <li><a href="https://community.aws/content/2Z6DlAohx12yuNoEAs7qb5YTH0q/leveraging-deepseek-r1-on-aws">Leveraging DeepSeek-R1 with CPU and GPU options on AWS </a>by <a href="https://community.aws/@wirjo">Daniel Wirjo</a></li> <li><a href="https://community.aws/content/2sHGS4Eqeekz32OOzn7am5lnGEX/benefits-of-installing-deepseek-on-an-aws-ec2-instance">Benefits of installing DeepSeek on an Amazon EC2 instance</a> by <a href="https://community.aws/@kikitos">Enrique Aguilar Martinez</a></li> <li><a href="https://community.aws/content/2sKnCT05v1WiD0Dw8QB5wfAf1Cm/deploying-deepseek-llama-model-on-amazon-ec2-inferentia-instance">Deploying DeepSeek Llama models on Amazon EC2 inferentia instance</a> by <a href="https://community.aws/@irshadc">Irshad Chohan</a></li> <li><a href="https://huggingface.co/blog/deepseek-r1-aws">How to deploy and fine-tune DeepSeek models on AWS</a> by <a href="https://huggingface.co/">Hugging Face</a></li> <li><a href="https://community.aws/content/2sJofoAecl6jVdDwVqglbZwKz2E/hosting-deepseek-r1-on-amazon-eks">Hosting DeepSeek-R1 on Amazon EKS Auto Mode</a> by <a href="https://community.aws/@tiagoreichert">Tiago Reichert</a></li> </ul> <p><b><u>Things to know</u></b><br> Here are a few important things to know.</p> <ul> <li><b>Pricing</b> – For publicly available models like DeepSeek-R1, you are charged only the infrastructure price based on inference instance hours you select for Amazon Bedrock Markeplace, Amazon SageMaker JumpStart, and Amazon EC2. For the Bedrock Custom Model Import, you are only charged for model inference, based on the number of copies of your custom model is active, billed in 5-minute windows. To learn more, check out the <a href="https://aws.amazon.com/bedrock/pricing/">Amazon Bedrock Pricing</a>, <a href="https://aws.amazon.com/sagemaker-ai/pricing/">Amazon SageMaker AI Pricing</a>, and <a href="https://aws.amazon.com/ec2/pricing/">Amazon EC2 Pricing</a> pages.</li> <li><b>Data security</b><b> </b>– You can use enterprise-grade security features in Amazon Bedrock and Amazon SageMaker to help you make your data and applications secure and private. This means your data is not shared with model providers, and is not used to improve the models. This applies to all models—proprietary and publicly available—like DeepSeek-R1 models on Amazon Bedrock and Amazon SageMaker. To learn more, visit <a href="https://aws.amazon.com/bedrock/security-compliance/">Amazon Bedrock Security and Privacy</a> and <a href="https://docs.aws.amazon.com/sagemaker/latest/dg/security.html">Security in Amazon SageMaker AI</a>.</li> </ul> <p><b><u>Now available</u></b><br> DeepSeek-R1 is generally available today in Amazon Bedrock Marketplace and Amazon SageMaker JumpStart in US East (Ohio) and US West (Oregon) AWS Regions. You can also use DeepSeek-R1-Distill models using Amazon Bedrock Custom Model Import and Amazon EC2 instances with AWS Trainum and Inferentia chips.</p> <p>Give DeepSeek-R1 models a try today in the <a href="https://console.aws.amazon.com/bedrock">Amazon Bedrock console</a>, <a href="https://console.aws.amazon.com/sagemaker">Amazon SageMaker AI console</a>, and <a href="https://console.aws.amazon.com/ec2">Amazon EC2 console</a>, and send feedback to <a href="https://repost.aws/tags/TAQeKlaPaNRQ2tWB6P7KrMag/amazon-bedrock">AWS re:Post for Amazon Bedrock</a> and <a href="https://repost.aws/tags/TAT80swPyVRPKPcA0rsJYPuA/amazon-sagemaker">AWS re:Post for SageMaker AI</a> or through your usual AWS Support contacts.</p> <p>— <a href="https://twitter.com/channyun">Channy</a></p> <p><em><strong>Updated on 1st February</strong> — Added more screenshots and demo video of Amazon Bedrock Playground.</em></p> <p><em><strong>Updated on 3rd February</strong> — Fixed unclear message for DeepSeek-R1 Distill model names and SageMaker Studio interface.</em></p> AWS Weekly roundup: EventBridge, SNS FIFO, Amazon Corretto, Amazon Connect, Amazon Bedrock, and more https://aws.amazon.com/blogs/aws/aws-weekly-roundup-eventbridge-sns-fifo-amazon-corretto-amazon-connect-amazon-bedrock-and-more/ <![CDATA[Sébastien Stormacq]]> Mon, 27 Jan 2025 16:55:43 +0000 <![CDATA[Amazon Bedrock]]> <![CDATA[Amazon Bedrock Agents]]> <![CDATA[Amazon Bedrock Prompt Flows]]> <![CDATA[Amazon Connect]]> <![CDATA[Amazon Corretto]]> <![CDATA[Amazon EventBridge]]> <![CDATA[Amazon Simple Notification Service (SNS)]]> <![CDATA[Announcements]]> <![CDATA[Application Integration]]> <![CDATA[Launch]]> <![CDATA[News]]> <![CDATA[Week in Review]]> 2d8347e4f1de45c60b539d8ba6549154adb1f854 I counted about 40 new launches from AWS since last week – back to our normal rhythm of releases. Services teams are listening to your feedback and developing little (or big) changes that makes your life easier when working with our services. The ability to support multiple sessions in the AWS Console is my favorite […] <p>I counted about 40 new launches from AWS since last week – back to our normal rhythm of releases. Services teams are listening to your feedback and developing little (or big) changes that makes your life easier when working with our services. The ability to support multiple sessions in the AWS Console is my favorite one so far in 2025.</p> <p>But our teams didn’t stop there, let’s look at the last week’s new announcements.</p> <p><span style="text-decoration: underline"><strong>Last week’s launches</strong></span></p> <p>Beside the usual Regional expansion (new capabilities that are now available in a new Region), here are the launches that got my attention.</p> <p><strong><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-eventbridge-direct-delivery-cross-account-targets/">Amazon EventBridge announces direct delivery to cross-account targets</a></strong> – <a href="https://aws.amazon.com/eventbridge/">Amazon EventBridge</a> is now able to deliver events to targets in another AWS account directly without having to send them to the default bus in the target account first. This will simplify so many architectures out there! It supports any target that supports <a href="https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies_identity-vs-resource.html">resource-based policies</a>, including <a href="https://aws.amazon.com/lambda/">AWS Lambda</a>, <a href="https://aws.amazon.com/sqs/">Amazon Simple Queue Service</a> (Amazon SQS), <a href="https://aws.amazon.com/sns/">Amazon Simple Notification Service</a> (Amazon SNS), <a href="https://aws.amazon.com/kinesis/">Amazon Kinesis</a>, and <a href="https://aws.amazon.com/api-gateway/">Amazon API Gateway</a>.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-corretto-january-2025-quarterly-updates/"><strong>Amazon Corretto quaterly update</strong></a> – We announced quarterly security and critical updates for <a href="https://aws.amazon.com/corretto/?filtered-posts.sort-by=item.additionalFields.createdDate&amp;filtered-posts.sort-order=desc">Amazon Corretto</a> Long-Term Supported (LTS) and Feature Release (FR) versions of OpenJDK. Corretto 23.0.2, 21.0.6, 17.0.14, 11.0.26, 8u442 are now available for download. Amazon Corretto is a no-cost, multi-platform, production-ready distribution of OpenJDK. You can download the updates from the <a href="https://aws.amazon.com/corretto">Corretto home page</a> or just type <a href="https://docs.aws.amazon.com/corretto/latest/corretto-21-ug/generic-linux-install.html"><code>apt-get</code> or <code>yum update</code></a>.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/high-throughput-mode-amazon-sns-fifo-topics/"><strong>High-throughput mode for Amazon SNS FIFO Topics</strong></a> – Amazon SNS now supports high-throughput mode for SNS FIFO topics, with default throughput matching SNS standard topics across all Regions. When you enable high-throughput mode, SNS FIFO topics will maintain order within message group, while reducing the deduplication scope to <em>the message-group level</em>. With this change, you can leverage up to 30K messages per second (MPS) per account by default in US East (N. Virginia) Region, and 9K MPS per account in US West (Oregon) and Europe (Ireland) Regions, and request quota increases for additional throughput in any Region.</p> <p><strong><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-connect-agent-workspace-audio-optimization-citrix-workspaces-virtual-desktops/">Amazon Connect agent workspace now supports audio optimization for Citrix and Amazon WorkSpaces virtual desktops</a></strong> – <a href="https://aws.amazon.com/connect/">Amazon Connect</a> agent workspace now supports the ability to redirect audio from Citrix and <a href="https://aws.amazon.com/workspaces-family/">Amazon WorkSpaces</a> Virtual Desktop Infrastructure (VDI) environments to a customer service agent’s local device. Audio redirection improves voice quality and reduces latency for voice calls handled on virtual desktops, providing a better experience for both end customers and agents.</p> <p><strong><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-redshift-history-mode-zero-etl-integrations/">Amazon Redshift announces support for History Mode for zero-ETL integrations</a> – </strong>This new capability enables you to build <a href="https://en.wikipedia.org/wiki/Slowly_changing_dimension">Type 2 Slowly Changing Dimension</a> (SCD 2) tables on your historical data from databases, out-of-the-box in <a href="https://aws.amazon.com/redshift/">Amazon Redshift</a>, without writing any code. History mode simplifies the process of tracking and analyzing historical data changes, allowing you to gain valuable insights from your data’s evolution over time.</p> <p>Finally, <a href="https://aws.amazon.com/bedrock/">Amazon Bedrock</a> has its own set of announcements. First, for anyone investing in <a href="https://en.wikipedia.org/wiki/Retrieval-augmented_generation">retrieval-augmented generation</a>, Bedrock now support multimodal content with <strong><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-bedrock-multimodal-cohere-embed-3-multilingual-english/">Cohere Embed 3 Multilingual and Embed 3 English</a></strong> models. This enables you to create embeddings to not only index text, but also images.</p> <p>Second, read <strong><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/luma-ais-ray2-visual-ai-model-amazon-bedrock/">Luma AI’s Ray2 visual AI model now available in Amazon Bedrock</a></strong>. Luma Ray2 is a large-scale video-generation model capable of creating realistic visuals with fluid, natural movement. With Luma Ray2 in Amazon Bedrock, you can generate production-ready video clips with seamless animations, ultrarealistic details, and logical event sequences with natural language prompts, removing the need for technical prompt engineering. Ray2 currently supports 5- and 9-second video generations with 540p and 720p resolution.</p> <p>And finally, <strong><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-bedrock-flows-multi-turn-conversation-support/">Amazon Bedrock Flows announces preview of multi-turn conversation support</a></strong>. <a href="https://aws.amazon.com/bedrock/flows/">Amazon Bedrock Flows</a>&nbsp;enables you to link foundation models (FMs), <a href="https://aws.amazon.com/bedrock/prompt-management/">Amazon Bedrock Prompts</a>, <a href="https://aws.amazon.com/bedrock/agents/">Amazon Bedrock Agents</a>, <a href="https://aws.amazon.com/bedrock/knowledge-bases/">Amazon Bedrock Knowledge Bases</a>, <a href="https://aws.amazon.com/bedrock/guardrails/">Amazon Bedrock Guardrails</a> and other AWS services together to build and scale pre-defined generative AI workflows. This week, the team announced preview of multi-turn conversation support for agent nodes in Flows. This capability enables dynamic, back-and-forth conversations between users and flows, similar to a natural dialogue.</p> <p><a href="https://aws.amazon.com/new/">For a full list of AWS announcements, be sure to keep an eye on the What's New at AWS page.</a></p> <p><span style="text-decoration: underline"><strong>Other AWS events<br> </strong></span>Check your calendar and sign up for upcoming AWS events.</p> <p>AWS Summits season is starting! I’m already working with the local team to prepare content for the Summits in Paris and London. Summits are free online and in-person events that bring the cloud computing community together to connect, collaborate, and learn about AWS. Stay updated by visiting the official <a href="https://aws.amazon.com/events/summits/">AWS Summit website</a> and sign up for notifications to learn when registration opens for events in your area.</p> <p><a href="https://aws.amazon.com/startups/lp/aws-gen-ai-lofts">AWS GenAI Lofts</a>&nbsp;are collaborative spaces and immersive experiences that showcase AWS expertise in cloud computing and AI. They provide startups and developers with hands-on access to AI products and services, exclusive sessions with industry leaders, and valuable networking opportunities with investors and peers.&nbsp;<a href="https://aws.amazon.com/startups/lp/aws-gen-ai-lofts#locations">Find a GenAI Loft location near you</a>, and don’t forget to register.</p> <p>Browse all upcoming&nbsp;<a href="https://aws.amazon.com/events/explore-aws-events/">AWS led in-person and virtual events here</a>.</p> <p>That’s all for this week. Check back next Monday for another Weekly Roundup!</p> <p><a href="https://twitter.com/sebsto">-- seb</a></p> <p><em>This post is part of our&nbsp;<a href="https://aws.amazon.com/blogs/aws/tag/week-in-review/">Weekly Roundup</a>&nbsp;series. Check back each week for a quick roundup of interesting news and announcements from AWS!</em></p> Luma AI’s Ray2 video model is now available in Amazon Bedrock https://aws.amazon.com/blogs/aws/luma-ai-ray-2-video-model-is-now-available-in-amazon-bedrock/ <![CDATA[Channy Yun (윤석찬)]]> Thu, 23 Jan 2025 19:50:22 +0000 <![CDATA[Amazon Bedrock]]> <![CDATA[Announcements]]> <![CDATA[Artificial Intelligence]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> c911f1c3eb11134cfe5eb5a0b59b0d2d821143b1 Amazon Bedrock now offers Luma AI's Ray2 video model, enabling users to generate high-quality, 5 or 9 second video clips with 540p and 720p resolution from text prompts, marking AWS as the exclusive cloud provider offering fully managed Luma AI models. <p>As we <a href="https://press.aboutamazon.com/aws/2024/12/luma-ai-announces-new-video-model-ray-2-will-soon-be-available-to-consumers-professionals-and-developers">preannounced</a> at AWS re:Invent 2024, you can now use <a href="https://aws.amazon.com/bedrock/luma-ai/">Luma AI Ray2 video model in Amazon Bedrock</a> to generate high-quality video clips from text, creating captivating motion graphics from static concepts. AWS is the first and only cloud provider to offer fully managed models from Luma AI.</p> <p>On January 16, 2025, <a href="https://lumalabs.ai/">Luma AI</a> introduced <a href="https://lumalabs.ai/ray">Luma Ray2</a>, the large–scale video generative model capable of creating realistic visuals with natural, coherent motion with strong understanding of text instructions. Luma Ray2 exhibits advanced capabilities as a result of being trained on Luma’s new multi-modal architecture. It scales to ten times compute of Ray1, enabling it to produce 5 second or 9 second video clips that show fast coherent motion, ultra-realistic details, and logical event sequences with 540p and 720p resolution.</p> <p>With Luma Ray2 in <a href="https://aws.amazon.com/bedrock/">Amazon Bedrock</a>, you can add high-quality, realistic, production-ready videos generated from text in your <a href="https://aws.amazon.com/generative-ai/">generative AI</a> application through a single API. Luma Ray2 video model understands the interactions between people, animals, and objects, and you can create consistent and physically accurate characters through state-of-the-art natural language instruction understanding and reasoning.</p> <p>You can use Ray2 video generations for content creation, entertainment, advertising, and media use cases, streamlining the creative process, from concept to execution. You can generate smooth, cinematic, and lifelike camera movements that match the intended emotion of the scene. You can rapidly experiment with different camera angles and styles and deliver creative outputs for architecture, fashion, film, graphic design, and music.</p> <p>Let’s take a look at the <a href="https://youtu.be/lIKRRRhHN2U">impressive video generations</a> by Luma Ray2 that Luma has published.</p> <p><iframe loading="lazy" title="Luma AI's Ray2 Video Model is now available in Amazon Bedrock | Amazon Web Services" width="500" height="281" src="https://www.youtube-nocookie.com/embed/lIKRRRhHN2U?feature=oembed" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen sandbox="allow-scripts allow-same-origin"></iframe></p> <p><u><strong>Get started with Luma Ray2 model in Amazon Bedrock</strong><br> </u>Before getting started, if you are new to using Luma models, go to the <a href="https://us-west-2.console.aws.amazon.com/bedrock/home?region=us-west-2#modelaccess">Amazon Bedrock console</a> and choose <strong>Model access</strong> on the bottom left pane. To access the latest Luma AI models, request access for Luma Ray2 in Luma AI.</p> <p><img loading="lazy" class="aligncenter wp-image-93395 size-full" style="width: 90%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/24/2025-luma-ray2-bedrock-1-enable-model-1.png" alt="" width="1874" height="994"></p> <p>To test the Luma AI model in Amazon Bedrock, choose <strong>Image/Video </strong>under <strong>Playgrounds </strong>in the left menu pane. Choose <strong>Select model</strong>, then select <strong>Luma AI</strong> as the category and<strong> Ray </strong>as the model.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93315" style="width: 90%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/17/2025-luma-ray2-bedrock-1-choose-model.png" alt="" width="1744" height="782"></p> <p>For video generation models, you should have an <a href="https://aws.amazon.com/s3/">Amazon Simple Storage Service (Amazon S3)</a> bucket to store all generated videos. This bucket will be created in your AWS account, and Amazon Bedrock will have read and write permissions for it. Choose <strong>Confirm </strong>to create a bucket and generate a video.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93316" style="width: 70%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/17/2025-luma-ray2-bedrock-2-creat-s3-bucekt.png" alt="" width="1244" height="632"></p> <p>I will generate a 5-second video with 720P and 24 frames per second with 16:9 aspect ratio for my prompt.</p> <p><img loading="lazy" class="aligncenter wp-image-93325 size-full" style="width: 100%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/17/2025-luma-ray2-bedrock-3-create-video.png" alt="" width="2746" height="1384"></p> <p>Here is an example prompt and generated video. You can download it stored in the S3 bucket.<br> <code>a humpback whale swimming through space particles</code></p> <p></p> <div style="width: 640px;" class="wp-video"> <video class="wp-video-shortcode" id="video-93300-1" width="640" height="360" preload="metadata" controls="controls"> <source type="video/mp4" src="https://d2908q01vomqb2.cloudfront.net/artifacts/AWSNews/2025/Ray2-Cosmic+Whale.mp4?_=1"> </video> </div> <p></p> <p>Here are another featured examples to demonstrate Ray2 model.</p> <p>Prompt 1: <code>A miniature baby cat is walking and exploring on the surface of a fingertip</code></p> <p></p> <div style="width: 640px;" class="wp-video"> <video class="wp-video-shortcode" id="video-93300-2" width="640" height="360" preload="metadata" controls="controls"> <source type="video/mp4" src="https://d2908q01vomqb2.cloudfront.net/artifacts/AWSNews/2025/Ray2-A+Miniature+Baby+Cat.mp4?_=2"> </video> </div> <p></p> <p>Prompt 2: <code>A massive orb of water floating in a backlit forest</code></p> <p></p> <div style="width: 640px;" class="wp-video"> <video class="wp-video-shortcode" id="video-93300-3" width="640" height="360" preload="metadata" controls="controls"> <source type="video/mp4" src="https://d2908q01vomqb2.cloudfront.net/artifacts/AWSNews/2025/Ray2-Floating+Water+Orb.mp4?_=3"> </video> </div> <p></p> <p>Prompt 3: <code>A man plays saxophone</code> by <a href="https://x.com/ziguratt">@ziguratt</a></p> <p></p> <div style="width: 640px;" class="wp-video"> <video class="wp-video-shortcode" id="video-93300-4" width="640" height="360" preload="metadata" controls="controls"> <source type="video/mp4" src="https://d2908q01vomqb2.cloudfront.net/artifacts/AWSNews/2025/Ray2-Saxophone+Player.mp4?_=4"> </video> </div> <p></p> <p>Prompt 4: <code>Macro closeup of a bee pollinating</code></p> <p></p> <div style="width: 640px;" class="wp-video"> <video class="wp-video-shortcode" id="video-93300-5" width="640" height="360" preload="metadata" controls="controls"> <source type="video/mp4" src="https://d2908q01vomqb2.cloudfront.net/artifacts/AWSNews/2025/Ray2-Pollen+Collector.mp4?_=5"> </video> </div> <p></p> <p>To check out more examples and generated videos, visit the <a href="https://lumalabs.ai/ray">Luma Ray2</a> page.</p> <p>By choosing <strong>View API request</strong> in the Bedrock console, you can also access the model using code examples in the <a href="https://aws.amazon.com/cli/">AWS Command Line Interface (AWS CLI)</a> and AWS SDKs. You can use <code>luma.ray-v2:0</code> as the model ID.</p> <p>Here is a sample of the AWS CLI command:</p> <pre><code class="lang-bash">aws bedrock-runtime start-async-invoke \ --region us-west-2 \ --model-id luma.ray-v2:0 \ --model-input "{ \"prompt\": \"a humpback whale swimming through space particles\", \"duration\":\"5s\", \"resolution\": \"540p\", \"aspect_ratio\":\"16:9\"}" \ --output-data-config "{\"s3OutputDataConfig\": {\"s3Uri\": \"s3:\/\/testing-bucket-ais-region-us-west-2\/\"}}"</code></pre> <p>You can use a <a href="https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_StartAsyncInvoke.html"><code>StartAsyncInvoke</code> API action</a> to generate videos using <a href="https://aws.amazon.com/developer/tools/">AWS SDKs</a> to build your applications using various programming languages.</p> <p><u><strong>Now available</strong><br> </u>Luma Ray2 video model is generally available today in Amazon Bedrock in the US West (Oregon) <a href="https://docs.aws.amazon.com/glossary/latest/reference/glos-chap.html#region">AWS Region</a>. Check the <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/models-regions.html">full Region list</a> for future updates. To learn more, check out the <a href="https://aws.amazon.com/bedrock/luma-ai/">Luma AI in Amazon Bedrock</a> product page and the <a href="https://aws.amazon.com/bedrock/pricing/">Amazon Bedrock Pricing</a> page.</p> <p>Give Luma Ray2 a try in the <a href="https://console.aws.amazon.com/bedrock">Amazon Bedrock console</a> today, and send feedback to <a href="https://repost.aws/tags/TAQeKlaPaNRQ2tWB6P7KrMag/amazon-bedrock">AWS re:Post for Amazon Bedrock</a> or through your usual AWS Support contacts.</p> <p>— <a href="https://twitter.com/channyun">Channy</a></p> <p><i><strong>Update January 24, 2025</strong> – The AWS CLI command was fixed to use the <code>start-async-invoke</code> parameter instead of <code>invoke-model</code>.</i></p> AWS Weekly Roundup: New AWS Mexico (Central) Region, simultaneous sign-in for multiple AWS accounts, and more (January 20, 2025) https://aws.amazon.com/blogs/aws/aws-weekly-roundup-new-aws-mexico-central-region-simultaneous-sign-in-for-multiple-aws-accounts-and-more-january-20-2025/ <![CDATA[Esra Kayabali]]> Mon, 20 Jan 2025 16:52:30 +0000 <![CDATA[Amazon EC2]]> <![CDATA[Announcements]]> <![CDATA[AWS CloudFormation]]> <![CDATA[AWS Management Console]]> <![CDATA[Launch]]> <![CDATA[News]]> <![CDATA[Week in Review]]> 156b5d31d6e320533cdb9b110de5d093b614cb42 As winter maintains its hold over where I live in the Netherlands, rare moments of sunlight become precious gifts. This weekend offered one such treasure—while cycling along a quiet canal, golden rays broke through the typically gray Dutch sky, creating a perfect moment of serenity. These glimpses of brightness feel particularly special during January, when […] <p><img loading="lazy" class="alignright" style="width: 202px !important;height: 270px !important" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/18/AWSNEWS-2120.jpeg" alt="" width="202" height="270">As winter maintains its hold over where I live in the Netherlands, rare moments of sunlight become precious gifts. This weekend offered one such treasure—while cycling along a quiet canal, golden rays broke through the typically gray Dutch sky, creating a perfect moment of serenity. These glimpses of brightness feel particularly special during January, when daylight can be scarce in our corner of Europe. As we move deeper into 2025, the third week of the new year brings both reflection and forward momentum. While global conversations swirl around technological advancements, it’s these small, personal moments that remind us to pause and appreciate the simple pleasures among our rapidly evolving world.</p> <p>Let’s look at the last week’s new announcements.</p> <p><span style="text-decoration: underline"><strong>Last week’s launches</strong></span><br> Here are the launches that got my attention.</p> <p><a href="https://aws.amazon.com/blogs/aws/now-open-aws-mexico-central-region/">AWS Mexico (Central) Region</a> – In February 2024, we announced plans to expand infrastructure in Mexico, and we’ve now launched the AWS Mexico (Central) Region with three Availability Zones and API code <strong>mx-central-1</strong>. This marks the first AWS infrastructure Region in Mexico and adds to our growing presence in Latin America. The new Region provides you with local workload management, data storage capabilities, enhanced performance with lower latency, and robust security standards. It features advanced cloud technologies, including cutting-edge artificial intelligence and machine learning (AI/ML) capabilities with purpose-built processors, comprehensive security capabilities with support for 143 security standards and compliance certifications. With this launch, AWS now spans 114 Availability Zones within 36 geographic Regions.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-management-console-simultaneous-sign-in-multiple-accounts/">AWS Management Console now supports simultaneous sign-in for multiple AWS accounts</a> – Using multi-session capability in the <a href="https://aws.amazon.com/console/">AWS Management Console</a>, you can now sign-in to multiple AWS accounts and manage your resources in a single browser. You can sign in to up to 5 sessions and this can be any combination of root, <a href="https://aws.amazon.com/iam/">AWS Identity and Access Management (IAM)</a>, or federated roles in different accounts or in the same account. You can scale your applications using multiple accounts following AWS best-practice guidelines. You can use accounts for different environments, such as development, testing, and production, and compare resource configurations and status across multiple accounts for troubleshooting application issues and other application related jobs.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-ec2-flex-instances-new-larger-sizes/">Introducing new larger sizes on Amazon EC2 Flex instances</a> – We’re announcing the general availability of two new larger sizes (12xlarge and 16xlarge) on <a href="https://aws.amazon.com/ec2/">Amazon Elastic Compute Cloud (Amazon EC2)</a> Flex (C7i-flex and M7i-flex) instances. The new sizes expand the EC2 Flex portfolio, providing additional compute options to scale up existing workloads or run larger-sized applications that need additional memory. These instances are powered by custom 4th Gen Intel Xeon Scalable processors, which are available only on AWS, and offer up to 15% better performance over comparable x86-based Intel processors used by other cloud providers. Flex instances are the easiest way to get price performance benefits and lower prices for a majority of compute-intensive and general-purpose workloads. They deliver up to 19% better price performance than comparable previous generation instances and are a great first choice for applications that don’t fully utilize the compute resources. Flex instances are ideal for web and application servers, batch processing, enterprise applications, databases, and more. For compute-intensive and general-purpose workloads that need even larger instance sizes (up to 192 vCPUs and 768 GiB memory) or continuous high CPU usage, you can use Amazon EC2 C7i and M7i instances.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-user-notifications-ga-cloudformation/">Announcing AWS User Notifications general availability on AWS CloudFormation</a> – You can use <a href="https://aws.amazon.com/notifications/">AWS User Notifications</a> to configure notifications to be sent using the AWS Management Console Notifications Center, email, <a href="https://aws.amazon.com/chatbot/">AWS Chatbot</a>, or mobile push notifications to the <a href="https://docs.aws.amazon.com/consolemobileapp/latest/userguide/what-is-consolemobileapp.html">AWS Console Mobile App</a> to keep you informed about important events such as <a href="https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/AlarmThatSendsEmail.html">Amazon CloudWatch alarms</a>. With this capability, you can define notification configurations as part of your infrastructure-as-code (IaC) practices and specify notification configurations for specific resource types within your <a href="https://aws.amazon.com/cloudformation/">AWS CloudFormation</a> templates. For example, you can set up notifications to trigger when an <a href="https://docs.aws.amazon.com/autoscaling/ec2/userguide/what-is-amazon-ec2-auto-scaling.html">Amazon EC2 Auto Scaling</a> group scales out, an <a href="https://aws.amazon.com/elasticloadbalancing/">Elastic Load Balancing (ELB)</a> load balancer is provisioned, or an <a href="https://aws.amazon.com/rds/">Amazon Relational Database Service (Amazon RDS)</a> database is modified. You have granular control over which events will trigger notifications and who should receive them.</p> <p><a href="https://aws.amazon.com/new/">For a full list of AWS announcements, be sure to keep an eye on the What's New at AWS page.</a></p> <p>We launched existing services and instance types in additional Regions:</p> <ul> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-ec2-m8g-instances-europe-stockholm/">Amazon EC2 M8g instances are now available in AWS Europe (Stockholm)</a> – These instances offer larger instance sizes with up to three times more vCPUs and memory compared to Graviton3 based Amazon M7g instances. AWS Graviton4 processors are up to 40% faster for databases, 30% faster for web applications, and 45% faster for large Java applications than AWS Graviton3 processors.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-direct-connect-expansion-queretaro-mexico/">AWS announces new AWS Direct Connect location and expansion in Querétaro, Mexico</a> – The Direct Connect service helps you establish a private, physical network connection between AWS and your data center, office, or colocation environment. These private connections can provide a more consistent network experience than those made over the public internet.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-ec2-c7i-flex-instances-govcloud-us-west-region/">Amazon EC2 C7i-flex instances are now available in AWS GovCloud (US-West) Region</a> – These instances expand the EC2 Flex instances portfolio to provide the easiest way for you to get price performance benefits for a majority of compute intensive workloads.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-backup-organization-wide-reports-govcloud/">AWS Backup now supports organization-wide reports in AWS GovCloud (US) Regions</a> – You can use <a href="https://aws.amazon.com/backup/">AWS Backup</a> <a href="https://docs.aws.amazon.com/aws-backup/latest/devguide/aws-backup-audit-manager.html">Audit Manager</a> to generate aggregated cross-account and cross-Region reports on your data protection policies and retrieve operational data about your backup and recovery activities.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-opensearch-serverless-asia-pacific-hong-kong-region/">Amazon OpenSearch Serverless is now available in Asia Pacific (Hong Kong) Region</a> – OpenSearch Serverless is a serverless deployment option for <a href="https://aws.amazon.com/opensearch-service/">Amazon OpenSearch Service</a> that makes it simple to run search and analytics workloads without the complexities of infrastructure management.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-backup-asia-pacific-thailand/">AWS Backup is now available in Asia Pacific (Thailand) Region</a> – Using AWS Backup, you can centrally create and manage backups of your application data, protect your data from inadvertent or malicious actions with immutable recovery points and vaults, and restore your data in the event of a data loss incident.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-guardduty-asia-pacific-malaysia-region/">Amazon GuardDuty is now available in Asia Pacific (Malaysia) Region</a> – You can now use this additional Region to continually monitor and detect anomalous behavior, security threats, and sophisticated multistage attack sequences targeting your AWS accounts to help protect your AWS accounts, workloads, and data.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-ec2-r8g-instances-additional-regions/">Amazon EC2 R8g instances are now available in additional Regions</a> – Amazon EC2 R8g instances are ideal for memory-intensive workloads such as databases, in-memory caches, and real-time big data analytics.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-ec2-i8g-instances-europe-frankfurt-region/">Amazon EC2 I8g instances are now available in Europe (Frankfurt) Region</a> – I8g instances offer the best performance in Amazon EC2 for storage-intensive workloads.</li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-s3-tables-additional-aws-regions/">Amazon S3 Tables are now available in five additional AWS Regions</a> – <a href="https://aws.amazon.com/s3/features/tables/">Amazon S3 Tables</a> deliver the first cloud object store with built-in Apache Iceberg support and the easiest way to store tabular data at scale. S3 Tables are specifically optimized for analytics workloads, resulting in up to three times faster query performance through continual table optimization compared to unmanaged Iceberg tables, and up to ten times higher transactions per second compared to Iceberg tables stored in general purpose S3 buckets.</li> </ul> <p><span style="text-decoration: underline"><strong>Other AWS events<br> </strong></span>Check your calendar and sign up for upcoming AWS events.</p> <p>AWS Summits are free online and in-person events that bring the cloud computing community together to connect, collaborate, and learn about AWS. Stay updated by visiting the official <a href="https://aws.amazon.com/events/summits/">AWS Summit website</a> and sign up for notifications to learn when registration opens for events in your area.</p> <p><a href="https://aws.amazon.com/startups/lp/aws-gen-ai-lofts">AWS GenAI Lofts</a>&nbsp;are collaborative spaces and immersive experiences that showcase AWS expertise in cloud computing and AI. They provide startups and developers with hands-on access to AI products and services, exclusive sessions with industry leaders, and valuable networking opportunities with investors and peers.&nbsp;<a href="https://aws.amazon.com/startups/lp/aws-gen-ai-lofts#locations">Find a GenAI Loft location near you</a>&nbsp;and don’t forget to register.</p> <p>Browse all upcoming&nbsp;<a href="https://aws.amazon.com/events/explore-aws-events/">AWS led in-person and virtual events here</a>.</p> <p>That’s all for this week. Check back next Monday for another Weekly Roundup!</p> <p><a href="https://www.linkedin.com/in/esrakayabali/">— Esra</a></p> <p><em>This post is part of our&nbsp;<a href="https://aws.amazon.com/blogs/aws/tag/week-in-review/">Weekly Roundup</a>&nbsp;series. Check back each week for a quick roundup of interesting news and announcements from AWS!</em></p> Now open — AWS Mexico (Central) Region https://aws.amazon.com/blogs/aws/now-open-aws-mexico-central-region/ <![CDATA[Elizabeth Fuentes]]> Tue, 14 Jan 2025 14:26:31 +0000 <![CDATA[Announcements]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> <![CDATA[Regions]]> 4697b81809f2a75e2d8932d0175b678882ca87b4 AWS launches its first cloud Region in Mexico, enabling digital transformation with local infrastructure, delivering low latency, and helping customers meet data residency requirements, backed by a planned $5 billion investment over 15 years. <p>In February 2024, we <a href="https://aws.amazon.com/es/blogs/aws/new-aws-region-in-mexico-is-in-the-works/">announced</a> plans to expand <a href="https://aws.amazon.com">Amazon Web Services (AWS)</a> infrastructure in Mexico. Today, I’m excited to announce the general availability of the AWS Mexico (Central) Region with three Availability Zones and <a href="https://docs.aws.amazon.com/general/latest/gr/rande.html#regional-endpoints">API code</a> <strong>mx-central-1</strong>. This new <a href="https://aws.amazon.com/about-aws/global-infrastructure/regions_az/">AWS Region</a> is the first AWS infrastructure Region in Mexico and adds to our growing presence in Latin America.</p> <p>The AWS Region in Mexico represents a significant commitment to the country’s digital future. AWS is planning to invest more than $5 billion in Mexico over 15 years. This AWS Region will provide customers with advanced and secure cloud technologies, including cutting-edge artificial intelligence (AI) and machine learning (ML) capabilities with purpose-built processors, while supporting Mexico’s growing digital economy. With this effort, AWS will support an average of more than 7,000 full-time equivalent jobs annually in Mexico, adding more than $10 billion to Mexico’s gross domestic product (GDP). AWS has also launched a $300,000 <a href="https://aws.amazon.com/about-aws/global-infrastructure/aws-incommunities/">AWS InCommunities</a> Fund in Queretaro to help local groups, schools, and organizations initiate new community projects.</p> <p></p> <div id="attachment_93007" style="width: 810px" class="wp-caption aligncenter"> <a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/09/mexico-fine-arts-feat-img.png"><img aria-describedby="caption-attachment-93007" loading="lazy" class="wp-image-93007 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/09/mexico-fine-arts-feat-img.png" alt="mexico city" width="800" height="400"></a> <p id="caption-attachment-93007" class="wp-caption-text">Palacio de Bellas Artes, Mexico City</p> </div> <p></p> <p>The AWS Mexico (Central) Region provides organizations in Mexico with a new option to run their workloads and store data locally. Organizations that need data residency capabilities, enhanced performance with lower latency, or robust security standards can now use infrastructure located in Mexico.</p> <p><span style="text-decoration: underline;"><strong>AWS in Mexico</strong></span><br> AWS has operated infrastructure in Mexico since 2020. The infrastructure includes seven <a href="https://aws.amazon.com/cloudfront/">Amazon CloudFront</a> edge locations, <a href="https://aws.amazon.com/outposts/">AWS Outposts</a>, and strategic offerings such as <a href="https://aws.amazon.com/about-aws/whats-new/2023/01/aws-local-zones-lagos-lima-queretaro/">AWS Local Zones in Queretaro</a> and <a href="https://aws.amazon.com/directconnect/locations/">AWS Direct Connect</a>. These infrastructure offerings help customers run low-latency applications while maintaining secure connectivity.</p> <p><span style="text-decoration: underline;"><strong>Performance and Innovation</strong></span><br> The AWS Mexico (Central) Region brings AWS infrastructure and services closer to local customers. With this new Region, AWS provides lower latency for customers in Mexico compared to using other AWS Regions. Customers will also be able to use our innovation in purpose-built processors, notably <a href="https://aws.amazon.com/ec2/graviton/">AWS Graviton,</a> that delivers up to 40% better price performance compared to x86-based <a href="https://aws.amazon.com/ec2/">Amazon EC2</a> instances across diverse workloads.</p> <p>This technological advantage extends to our cutting-edge AI and ML capabilities, including:</p> <ul> <li>Advanced ML infrastructure with <a href="https://aws.amazon.com/ai/machine-learning/trainium/">AWS Trainium</a> and <a href="https://aws.amazon.com/ai/machine-learning/inferentia/">AWS Inferentia</a> for scalable generative AI deployment.</li> <li>Purpose-built processors optimized for cloud workloads to deliver best price-performance.</li> </ul> <p><span style="text-decoration: underline;"><strong>Security and Compliance</strong></span><br> AWS provides <a href="https://aws.amazon.com/security/">comprehensive security capabilities</a> with support for 143 security standards and compliance certifications, including <a href="https://aws.amazon.com/compliance/pci-dss-level-1-faqs/">PCI-DSS</a>, <a href="https://aws.amazon.com/compliance/hipaa-compliance/">HIPAA</a>/<a href="https://www.hhs.gov/hipaa/for-professionals/special-topics/hitech-act-enforcement-interim-final-rule/index.html">HITECH</a>, <a href="https://aws.amazon.com/compliance/fedramp/">FedRAMP</a>, <a href="https://aws.amazon.com/compliance/gdpr-center/">GDPR</a>, <a href="https://aws.amazon.com/compliance/fips/">FIPS 140-2</a>, and <a href="https://aws.amazon.com/compliance/nist/">NIST</a> 800-171. All AWS customers own their data, choose where to store it, and decide if/when to move it. This means customers storing content in the AWS Mexico (Central) Region have the assurance that their content will not leave Mexico, unless they chose to move it.</p> <p><span style="text-decoration: underline;"><strong>AWS Customers in Mexico</strong></span><br> Leading Mexican organizations are already achieving significant results with AWS. Companies such as <a href="https://aeromexico.com/">Aeroméxico</a>, <a href="https://www.santander.com.mx/">Banco Santander Mexico</a>, <a href="https://cinepolis.com/">Cinépolis</a>, <a href="https://www.gruposalinas.com/">Grupo Salinas</a>, <a href="http://www.kavak.com">Kavak</a>, <a href="https://www.palaceresorts.com/">Palace Resorts</a>, and <a href="https://www.vector.com.mx/">Vector Casa de Bolsa</a> are running mission-critical workloads on AWS. Here are key examples:</p> <p><a href="https://www.bbva.com/en/innovation/bbva-selects-aws-to-accelerate-its-data-driven-transformation/"><strong>BBVA</strong></a>, a leading multinational financial services company, is using AWS to accelerate its data-driven transformation. Using <a href="https://aws.amazon.com/sagemaker/">Amazon SageMaker</a> and <a href="https://aws.amazon.com/bedrock/">Amazon Bedrock</a>, BBVA is empowering over 1,000 data scientists to build, train, and deploy machine learning models efficiently. This technology enables BBVA to explore advanced technologies and create innovative financial solutions, supporting their goal of becoming a true data and AI-driven digital organization.</p> <p class="jss225" data-pm-slice="1 1 [&quot;bulletList&quot;,{},&quot;listItem&quot;,{}]"><strong><a href="https://grupomultimedios.com/">Grupo Multimedios</a>, </strong>a leading Mexican media group, is pioneering the use of generative AI, by implementing Amazon Bedrock for their <a href="https://aws.amazon.com/what-is/media-asset-management/">media asset manager (MAM)</a>, reducing content research time by 88%, decreasing news generation time by 40%, and increasing content production by 70% (250 additional news items daily). As the fastest-growing media group embracing technological leadership, their AI implementation demonstrates a commitment to innovation while streamlining operations.</p> <p data-pm-slice="1 1 [&quot;bulletList&quot;,{},&quot;listItem&quot;,{}]"><strong><a href="https://www.bowheadhealth.com/">Bowhead Health</a></strong>, a digital healthcare company, is revolutionizing cancer research by using Amazon Bedrock to accelerate the research pipeline. The company has built a vast, de-identified dataset that’s ready for analysis without traditional recruitment barriers. Bowhead Health also delivers robust, real-world insights to drive faster breakthroughs in oncology drug development.</p> <p data-pm-slice="1 1 [&quot;bulletList&quot;,{},&quot;listItem&quot;,{}]"><strong><a href="https://aws.amazon.com/solutions/case-studies/skyalert/?did=cr_card&amp;trk=cr_card">SkyAlert</a></strong>, an innovative technology company protecting millions in earthquake-prone areas, transformed its alert system by migrating to AWS in 2018. Before AWS, their system required 20 virtual machines and experienced significant delays during critical moments. Using <a href="https://aws.amazon.com/lambda/">AWS Lambda</a>, <a href="https://aws.amazon.com/fargate/">AWS Fargate</a>, and <a href="https://aws.amazon.com/pinpoint/">Amazon Pinpoint</a>, they can now scale automatically and deliver messages to users quickly. With the opening of the AWS Mexico (Central) Region, SkyAlert anticipates further improvements to their services with local AWS infrastructure. As <strong>Santiago Cantú, Co-Founder of SkyAlert,</strong> explains, “The opening of the AWS Region in Mexico is an extremely important event for SkyAlert and for the security of those who trust us. Having local AWS infrastructure will improve our ability to deliver critical alerts, which potentially save lives, even faster and more reliably. This perfectly aligns with our mission to provide the most robust and advanced earthquake early warning system available. The new Region will allow us to take even greater advantage of AWS services, ensuring that we continue to be at the forefront of innovation in disaster preparedness.”</p> <p><span style="text-decoration: underline;"><strong>Building Skills Together</strong></span><br> AWS has made significant investments in upskilling initiatives in Mexico including:</p> <ul> <li>Training over 500,000 individuals in cloud technology since 2017.</li> <li>Collaborating with the the <a href="https://e.economia.gob.mx/">Ministry of Economy</a> to train 138,000 people in digital technology as of 2024.</li> <li>Partnering with universities like <a href="https://www.up.edu.mx/">Universidad Panamericana</a> and <a href="https://tec.mx">Tec de Monterrey</a> to teach digital skills.</li> <li>Training programs with <a href="https://canacintra.org.mx/camara/">Canacintra</a> for 20,000 Small and Medium Businesses (SMB)&nbsp;leaders.</li> </ul> <p><span style="text-decoration: underline;"><strong>AWS Commitment to Sustainability</strong></span><br> Amazon is committed to reaching net-zero carbon across its business by 2040. A <a href="https://sustainability.aboutamazon.com/carbon-reduction-aws.pdf">recent Accenture study</a> shows that running workloads on AWS is up to 4.1 times more energy-efficient than on-premises environments. When workloads are optimized on AWS, the associated carbon footprint can be lowered by up to 99%. The AWS Mexico (Central) Region incorporates sustainable design practices, using air-cooling technology that eliminates the need for cooling water in operations. With this new Region, customers will also benefit from AWS sustainability efforts across its infrastructure. To learn more about sustainability at AWS, visit the <a href="http://aws.amazon.com/about-aws/sustainability">AWS Cloud sustainability page</a>.</p> <p><span style="text-decoration: underline;"><strong>Things to know</strong></span><br> <strong>AWS Community in Mexico</strong> – The AWS Community in Mexico is one of the most vibrant in Latin America, with <a href="https://aws.amazon.com/developer/community/community-builders/community-builders-directory/?cb-cards.sort-by=item.additionalFields.cbName&amp;cb-cards.sort-order=asc&amp;awsf.builder-category=*all&amp;awsf.location=*all&amp;awsf.year=*all&amp;cb-cards.q=mexico&amp;cb-cards.q_operator=AND">26+ AWS Community Builders</a> and 15 <a href="https://aws.amazon.com/es/developer/community/usergroups/?community-user-groups-cards.sort-by=item.additionalFields.ugName&amp;community-user-groups-cards.sort-order=asc&amp;awsf.location=*all&amp;awsf.category=*all&amp;community-user-groups-cards.q=mexico&amp;community-user-groups-cards.q_operator=AND">AWS User Groups</a>. These groups are located in <a href="https://www.meetup.com/Amazon-Web-Services-Jalisco/">Jalisco</a>, Puebla, <a href="https://www.meetup.com/AWS-User-Group-Monterrey/">Monterrey</a>, <a href="https://www.meetup.com/comunidad-aws-merida-yucatan/">Mérida</a>, <a href="https://www.meetup.com/es-ES/ajolotesenlanube/">Mexico City</a>, Mexicali, Cancún, León, <a href="https://www.meetup.com/Amazon-Web-Services-Queretaro/">Querétaro</a>, San Luis Potosí, <a href="https://www.meetup.com/aws-user-group-ensenada/">Ensenada</a>, <a href="https://www.meetup.com/aws-user-group-saltillo/">Saltillo</a>, Tijuana, and <a href="https://www.meetup.com/aws-ug-villahermosa/">Villahermosa</a>, plus a specialized User Group called <a href="https://www.meetup.com/Embajadoras-Cloud/">Embajadoras cloud</a> (Cloud ambassadors) focused on women’s professional development. Together, these groups comprise 9,000+ total members.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/22/mexico_CD.png"><img loading="lazy" class="aligncenter size-large wp-image-91388" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/22/mexico_CD-1024x329.png" alt="" width="1024" height="329"></a></p> <p><strong><a href="https://aws.amazon.com/about-aws/global-infrastructure/">AWS Global footprint</a> </strong>– With this launch, AWS now spans 114 Availability Zones within 36 geographic Regions.</p> <p><strong>Available now</strong> – The new AWS Mexico (Central) Region is ready to support your business, and you can find a detailed list of the services available in this Region on the <a href="https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/">AWS Services by Region</a>&nbsp;page.</p> <p>To start building in <strong>mx-central-1</strong>, visit the&nbsp;<a href="https://aws.amazon.com/about-aws/global-infrastructure/">AWS Global Infrastructure</a> page.</p> <p>Thanks to <a href="https://www.linkedin.com/in/vikomex/">David Victoria</a> for the <a href="https://www.linkedin.com/company/awscommunitymx/">AWS Community México</a> 2024 photo.</p> <p>— <a href="https://www.linkedin.com/in/lizfue/">Eli</a></p> AWS Weekly Roundup: New Asia Pacific Region, DynamoDB updates, Amazon Q developer, and more (January 13, 2025) https://aws.amazon.com/blogs/aws/aws-weekly-roundup-new-asia-pacific-region-dynamodb-updates-amazon-q-developer-and-more-january-13-2025/ <![CDATA[Betty Zheng (郑予彬)]]> Mon, 13 Jan 2025 17:29:48 +0000 <![CDATA[Amazon Connect]]> <![CDATA[Amazon DynamoDB]]> <![CDATA[Amazon Q Developer]]> <![CDATA[Amazon SageMaker]]> <![CDATA[Announcements]]> <![CDATA[AWS Chatbot]]> <![CDATA[AWS PrivateLink]]> <![CDATA[AWS Transit Gateway]]> <![CDATA[Launch]]> <![CDATA[News]]> <![CDATA[Week in Review]]> 1acc45900a7fda30d9bf8fb9760ddc9d5552bb16 As we move into the second week of 2025, China is celebrating Laba Festival (腊八节), a traditional holiday, which marks the beginning of Chinese New Year preparations. On this day, Chinese people prepare Laba congee, a special porridge combining various grains, dried fruits, and nuts. This nutritious mixture symbolizes harmony, prosperity, and good fortune — […] <p><img loading="lazy" class="alignright wp-image-93258" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/10/eraser_20250110103729866-300x240.jpg" alt="" width="420" height="336">As we move into the second week of 2025, China is celebrating Laba Festival (腊八节), a traditional holiday, which marks the beginning of Chinese New Year preparations. On this day, Chinese people prepare <a href="https://en.wikipedia.org/wiki/Laba_congee">Laba congee</a>, a special porridge combining various grains, dried fruits, and nuts. This</p> <p>nutritious mixture symbolizes harmony, prosperity, and good fortune — with each ingredient representing the diversity and abundance of life. This traditional practice dates back to when Buddha achieved enlightenment after consuming rice porridge, making it a symbol of both material and spiritual nourishment. The festival, occurring on the eighth day of the twelfth lunar month, marks the countdown to Spring Festival, China’s most significant traditional holiday celebrating family reunion and renewal.</p> <p>As our global tech community grows, such cultural celebrations remind us of the importance of inclusive innovation and shared progress.</p> <p><strong>Last week’s launches</strong></p> <p>Let’s take a look at what <a href="https://aws.amazon.com/">Amazon Web Services (AWS)</a> launched in this week.</p> <p><a href="https://aws.amazon.com/blogs/aws/announcing-the-new-aws-asia-pacific-thailand-region/">New AWS Asia Pacific (Thailand) Region</a>– AWS has expanded its global infrastructure with the launch of the new Asia Pacific (Thailand) <a href="https://docs.aws.amazon.com/glossary/latest/reference/glos-chap.html#region">AWS Region</a>, featuring three Availability Zones. With this addition, customers in Thailand and throughout Southeast Asia can serve customers with reduced latency while maintaining data residency within Thailand. The newly launched Region supports the complete range of AWS services and strengthens our presence in the rapidly growing ASEAN market.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/aws-direct-connect-location-expansion-bangkok-thailand/">New AWS Direct Connect location in Bangkok</a> – Following the launch of our Thailand Region, we’ve established a new <a href="https://aws.amazon.com/directconnect/">AWS Direct Connect</a> location in Bangkok and expanded our existing infrastructure. This addition provides customers in Thailand with improved connectivity options and reduced network latency when accessing AWS services.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/09/news-2024-thailand-region.jpg"><img loading="lazy" class="aligncenter size-full wp-image-93249" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/09/news-2024-thailand-region.jpg" alt="" width="1819" height="927"></a></p> <p><em>Database and analytics</em></p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-dynamodb-configurable-point-in-time-recovery-periods/">Configurable point-in-time recovery periods for Amazon DynamoDB</a> – <a href="https://aws.amazon.com/dynamodb/?nc2=type_a">Amazon DynamoDB</a> now enables customizable point-in-time recovery (PITR) periods, which means customers can specify recovery durations ranging from 1 to 35 days on a per-table basis. This enhancement enables organizations to meet precise compliance requirements while maximizing cost-efficiency. The feature is now available across all AWS Regions, including AWS GovCloud (US West) and China Regions. This flexibility in data recovery periods empowers customers to align their backup policies precisely with their business requirements and regulatory obligations.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-msk-connect-apis-aws-privatelink/">Amazon MSK Connect APIs with AWS PrivateLink</a> – <a href="https://aws.amazon.com/msk/features/msk-connect/">Amazon Managed Streaming for Apache Kafka Connect (Amazon MSK Connect)</a> APIs now support<a href="https://aws.amazon.com/privatelink/"> AWS PrivateLink</a>, giving customers access to MSK Connect APIs through private endpoints within their virtual private cloud (VPC). This enhancement provides increased security and reduced data exposure by keeping traffic within the AWS network.</p> <p><em>Generative AI and machine learning</em></p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-q-developer-sagemaker-code-editor-ide/">Amazon Q Developer in SageMaker Code Editor</a>– <a href="https://aws.amazon.com/q/developer/?nc2=type_a">Amazon Q Developer</a> is now integrated into the <a href="https://aws.amazon.com/sagemaker/?nc2=type_a">Amazon SageMaker</a> Code Editor integrated development environment (IDE), enhancing the developer’s experience with AI-powered code assistance. Intelligent code suggestions, documentation assistance, and contextual recommendations are now directly available within the SageMaker development environment.</p> <p><em>Management and governance</em></p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/20-additional-aws-systems-manager-automation-runbook-recommendations-chatbot/">AWS Systems Manager Automation in AWS Chatbot</a> – <a href="https://aws.amazon.com/chatbot/?nc2=type_a">AWS Chatbot</a> now offers 20 additional <a href="https://aws.amazon.com/systems-manager/?nc2=type_a">AWS Systems Manager</a> Automation runbook recommendations, expanding its capabilities for automated operations management. These new recommendations help customers streamline their operational tasks and implement best practices more efficiently through chat-based interactions.</p> <p><a href="https://aws.amazon.com/blogs/networking-and-content-delivery/analyzing-aws-transit-gateway-data-processing-charges-with-cost-allocation-tags/">AWS Transit Gateway cost analysis enhancement</a> – We’ve introduced new capabilities for analyzing Transit Gateway data processing charges using cost allocation tags. This feature provides improved visibility and control over networking costs, enabling organizations to track and optimize <a href="https://aws.amazon.com/transit-gateway/">AWS Transit Gateway</a> usage efficiently. The enhanced cost analysis tools deliver detailed insights into network traffic patterns and associated costs.</p> <p><strong>Other AWS news and highlights</strong></p> <p><a href="https://aws.amazon.com/blogs/devops/the-most-visited-devops-and-developer-productivity-blog-posts-in-2024-copy/">2024’s most popular DevOps blog posts</a> – The retrospective blog post “The most visited DevOps and Developer Productivity blog posts in 2024” has reached the top one position on this week’s AWS most popular articles chart. This compilation presents the most influential DevOps content from 2024, offering insights into trending topics and best practices. The collection examines key developments in continuous integration and continuous development (CI/CD), infrastructure as code (IaC), and automation practices.</p> <p><a href="https://aws.amazon.com/blogs/security/new-aws-skill-builder-course-available-securing-generative-ai-on-aws/">New security course for generative AI</a> – <a href="https://explore.skillbuilder.aws/learn">AWS Skill Builder</a> has released a new course focusing on securing <a href="https://aws.amazon.com/generative-ai/">generative AI</a> applications on AWS. This comprehensive training teaches professionals to implement security best practices for <a href="https://aws.amazon.com/training/learn-about/machine-learning/">artificial intelligence and machine learning (AI/ML)</a> workloads, addressing data protection, model security, and compliance requirements. The course meets the growing demand for specialized security knowledge in the rapidly evolving field of generative AI.</p> <p><a href="https://aws.amazon.com/about-aws/whats-new/2025/01/amazon-connect-contact-lens-free-trials-conversational-analytics-performance-evaluations/">Amazon Connect Contact Lens free trials</a> – We’re introducing free trials for first-time users of <a href="https://aws.amazon.com/connect/contact-lens/">Amazon Connect Contact Lens</a> conversational analytics and performance evaluations. New customers can process up to 100,000 voice minutes monthly at no cost for 2 months, and first-time performance evaluation users receive a 30-day free trial starting with their first evaluation. With this initiative, customers can experience Contact Lens capabilities in their environment without additional costs. The free trials are available across all <a href="https://docs.aws.amazon.com/connect/latest/adminguide/regions.html#contactlens_region">AWS Regions</a> where Contact Lens is supported.</p> <p>For a full list of AWS announcements, be sure to keep an eye on the <a href="https://aws.amazon.com/new/">What’s New with AWS page.</a></p> <p>Whether you’re a developer, architect, business leader, or you’re starting your cloud journey – and regardless of what 2024 brought your way – 2025 presents new opportunities for everyone.</p> <p>This post is part of our&nbsp;<a href="https://aws.amazon.com/blogs/aws/tag/week-in-review/">Weekly Roundup series</a>. Check back each week for a quick roundup of interesting news and announcements from AWS!</p> <p>– <a href="https://www.linkedin.com/in/zhengyubin714/">Betty</a></p> Announcing the new AWS Asia Pacific (Thailand) Region https://aws.amazon.com/blogs/aws/announcing-the-new-aws-asia-pacific-thailand-region/ <![CDATA[Donnie Prakoso]]> Wed, 08 Jan 2025 02:30:36 +0000 <![CDATA[Announcements]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> <![CDATA[Regions]]> 3acab191e810ab04e856c629a911bcd01c319944 AWS launches Asia Pacific (Thailand) Region with 3 Availability Zones, accelerating cloud adoption. Strategically located to meet data residency needs, it drives innovation across industries. Early AWS adopters in Thailand share transformative success stories. Get started now! <p>Today, we’re pleased to announce that the AWS Asia Pacific (Thailand) Region is now generally available with three Availability Zones and API name <code>ap-southeast-7</code>.</p> <p>The AWS Asia Pacific (Thailand) Region is the first infrastructure Region in Thailand and the fourteenth Region in Asia Pacific, joining existing Regions in Hong Kong, Hyderabad, Jakarta, Malaysia, Melbourne, Mumbai, Osaka, Seoul, Singapore, Sydney, and Tokyo, as well as the Beijing and Ningxia China Regions.</p> <div id="attachment_92882" style="width: 1829px" class="wp-caption aligncenter"> <img aria-describedby="caption-attachment-92882" loading="lazy" class="wp-image-92882 size-full" style="border: 1px solid black; padding: 3px;" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/03/news-2024-thailand-region.jpg" alt="" width="1819" height="927"> <p id="caption-attachment-92882" class="wp-caption-text"><em>Lumphini Park, one of the largest green spaces in central Bangkok spanning 142 acres.</em></p> </div> <p>The adoption of cloud computing has gained significant momentum in Thailand, driven by evolving business needs and government initiatives such as <a href="https://www.boi.go.th/upload/content/Thailand,%20Taking%20off%20to%20new%20heights%20@%20belgium_5ab4e8042850e.pdf">Thailand 4.0</a>. These initiatives aim to transform Thailand into an innovation-driven economy by using emerging technologies to enhance productivity, competitiveness, and sustainable growth.</p> <p>The new AWS Region will help startups, enterprises, government agencies, educational institutions, and nonprofit organizations run their applications and serve end users while maintaining data residency in Thailand. This aligns with Thailand’s digital transformation goals and the growing demand for cloud services. Over the next 15 years, Amazon Web Services (AWS) planned investments in Thailand are estimated to contribute $10B to Thailand’s Gross Domestic Product (GDP) and support an estimated average of 11,000 full-time equivalent (FTE) jobs in local Thai businesses annually.</p> <p><strong><span style="text-decoration: underline;">Growing presence of AWS in Thailand</span><br></strong>Our journey in Thailand began in 2013 with the first AWS office in Bangkok. Since then, AWS has continuously expanded its infrastructure and services in the country:</p> <p><strong><a href="https://aws.amazon.com/cloudfront/">Amazon CloudFront</a></strong> – Since 2020, AWS has established six Amazon CloudFront edge locations throughout Thailand. These edge locations are part of the highly secure and programmable AWS content delivery network (CDN), designed to accelerate the delivery of data, videos, applications, and APIs to users worldwide with low latency and high transfer speeds.</p> <p><strong><a href="https://aws.amazon.com/outposts/">AWS Outposts</a></strong> – In the same year, 2020, AWS introduced AWS Outposts to the Thai market. As a fully managed solution, AWS Outposts brings AWS infrastructure and services to virtually any on-premises or edge location, enabling a truly consistent hybrid experience. This service is particularly valuable for workloads that require low latency, local data processing, or local data storage.</p> <p><strong><a href="https://aws.amazon.com/about-aws/global-infrastructure/localzones/">AWS Local Zones</a></strong> – In 2022, AWS strengthened its commitment to Thailand by launching AWS Local Zones in Bangkok. This infrastructure deployment places compute, storage, database, and other select services closer to large population, industry, and IT centers. As a result, customers can deliver applications requiring single-digit millisecond latency to end users.</p> <p><strong><a href="https://aws.amazon.com/directconnect/">AWS Direct Connect</a></strong> – AWS established a AWS Direct Connect location in Bangkok in 2023 to enhance connectivity options and added a new AWS Direct Connect location with the launch of the AWS Asia Pacific (Thailand) Region. Customers can use AWS Direct Connect to establish secure and dedicated network connections to their AWS resources, providing improved network performance and reduced bandwidth costs.</p> <p><span style="text-decoration: underline;"><strong>AWS customer success stories in Thailand<br></strong></span>Organizations in Thailand are using our services to drive innovation and transformation. Here are a few examples:</p> <p><a href="https://aws.amazon.com/solutions/case-studies/2c2p-case-study/"><strong>2C2P</strong></a><br>2C2P, a leading Thailand-based FinTech startup, chose AWS for its robust security capabilities. As an omnichannel payment service provider in Southeast Asia, the company processes millions of customer payments globally using AWS CloudHSM for cryptographic key management, AWS Shield for distributed denial of service (DDoS) protection, and AWS Secrets Manager to safeguard sensitive credentials.</p> <p>“Through AWS, we’ve unlocked the power to securely, dynamically, and compliantly scale to meet the surge in payment transaction volumes. AWS CloudHSM plays a pivotal role in fulfilling compliance requirements and propelling us toward accelerated business expansion,” says Myo Zaw, Chief Technology Officer at 2C2P.</p> <p><strong><a href="https://press.aboutamazon.com/aws/2024/6/southeast-asian-brands-thrive-with-acommerces-new-generative-ai-powered-data-platform-powered-by-aws">aCommerce</a><br></strong>aCommerce, the largest ecommerce enabler in Southeast Asia, has revolutionized market intelligence by launching AskIQ, a generative AI–powered feature on AWS. This software as a service (SaaS) platform provides the world’s leading brands with comprehensive competitor and category performance tracking capabilities across Southeast Asia’s largest ecommerce sites.</p> <p>Leena Chanvirach, VP of Data Products at aCommerce Group, emphasizes the strategic value of their AWS collaboration: “Our collaboration with AWS allows clients to double down on their core competencies and business priorities. This best-of-both-worlds approach gives brands a competitive edge without the burden of building and maintaining sophisticated data infrastructure in-house.”</p> <p><a href="https://aws.amazon.com/solutions/case-studies/ascend-money-case-study/"><strong>Ascend Money</strong></a><br>Ascend Money, a leading Southeast Asian FinTech company, achieved a 70 percent reduction in compute costs while simultaneously improving application performance by up to 40 percent in certain workloads. Ascend Money implemented a sophisticated compute strategy using Amazon EC2 instances, resulting in significant operational improvements.</p> <p>“AWS has significantly improved our performance, enabling us to deliver more innovative services to our customers,” says Peerawit Phuangkaeo, Head of Technical Operations at Ascend Money.</p> <p><span style="text-decoration: underline;"><strong>Building cloud skills together<br></strong></span>AWS has built comprehensive programs for cloud education and skills development in Thailand, training more than 50,000 individuals in cloud skills since 2017. Here are some of the programs:</p> <p><a href="https://skillbuilder.aws/"><strong>AWS Skill Builder</strong></a><br>AWS Skill Builder&nbsp;is an online learning center where you can learn from AWS experts and build cloud skills online. AWS has made cloud education more accessible to Thai learners by offering more than 600 courses, with 106 courses specifically available in Thai language. The recent launch of the Amazon AI Ready initiative has further expanded the learning opportunities, particularly in the growing field of AI.</p> <p><strong><a href="https://aws.amazon.com/education/awseducate/">AWS Educate</a><br></strong>Since its introduction in 2016, AWS Educate has played a transformative role in Thai education. The program has successfully integrated cloud computing into educational curricula across Thailand, providing students with direct access to AWS resources and hands-on experience. The impact has been substantial, with over 20,000 Thai students enrolled in the program. Beyond student education, AWS Educate has invested in training Thai educators, preparing them to deliver engaging and practical cloud computing courses that prepare students for the demands of the digital economy.</p> <p><strong><a href="https://aws.amazon.com/training/awsacademy/">AWS Academy</a><br></strong>AWS Academy has been instrumental in connecting academic learning with industry needs since its launch in Thailand in 2017. Through strategic partnerships with more than 30 leading universities and colleges across the country, AWS Academy has created a robust pipeline of cloud-skilled professionals. The program provides educational institutions with comprehensive cloud computing curricula that align with industry needs, making sure that students graduate with practical, job-ready skills.</p> <p>Through these various initiatives and programs, AWS is not just providing educational resources, it’s building a foundation for Thailand’s digital future by helping equip the workforce with the necessary skills to use cloud technologies effectively.</p> <p><span style="text-decoration: underline;"><strong>Supporting sustainable innovation in Thailand<br></strong></span>The AWS commitment to sustainability extends to supporting innovative companies in Thailand that are driving environmental initiatives.</p> <p><a href="https://bo-da.co/en-us/about-us"><strong>BODA Technology &amp; Consultancy</strong></a><br>BODA, an AWS powered sustainability startup, uses AWS IoT Core to develop AI-powered solutions for energy efficiency optimization. The company has successfully improved operations in over 100,000 buildings and factories across Thailand, enabling these facilities to maximize efficiency while reducing costs and environmental impact.</p> <p><a href="https://www.gpscgroup.com/en/home"><strong>GPSC Group</strong></a><br>GPSC Group, a leading sustainable power company in Thailand, demonstrates how AWS supports the energy sector’s digital transformation. Following the merger between Global Power Synergy Public Company and Glow Energy, the group chose AWS Cloud for migrating its photovoltaic solar plant operations. Working with AWS and AWS Partner <a href="https://www.dailitech.com/">Dailitech</a>, GPSC Group has achieved a 20–25 percent reduction in hardware, software, and licensing costs since moving to the cloud.</p> <p><span style="text-decoration: underline;"><strong>Things to know<br></strong></span><strong>AWS Community in Thailand</strong> — Thailand is home to two AWS Heroes, seven AWS Community Builders, and more than 17,000 members of the AWS User Group. If you’re interested in joining AWS User Group Thailand, visit their <a href="https://www.facebook.com/groups/696722700418928">Facebook</a> page.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93165" style="border: 1px solid black; padding: 3px;" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/18/2024-news-thailand-community.jpg" alt="" width="1567" height="1045"></p> <p><strong>AWS Global footprint</strong> — AWS now spans 111 Availability Zones within 35 geographic regions worldwide. We have announced plans for 15 more Availability Zones and five more AWS Regions in Germany, Taiwan, Mexico, the Kingdom of Saudi Arabia, and New Zealand.&nbsp;</p> <p>The new Asia Pacific (Thailand) Region is ready to support your business. To learn more, visit the <a href="https://aws.amazon.com/about-aws/global-infrastructure/">AWS Global Infrastructure</a> page and start building on <code>ap-southeast-7</code>!</p> <p>Happy building!<br>— <a href="https://linkedin.com/in/donnieprakoso">Donnie</a></p> Happy New Year! AWS Weekly Roundup: 2025 Tech Predictions, Llama 3.3 70B, Stable Diffusion 3.5 Large, custom billing view, and more (January 6, 2025) https://aws.amazon.com/blogs/aws/happy-new-year-aws-weekly-roundup-2025-tech-predictions-llama-3-3-70b-stable-diffusion-3-5-large-custom-billing-view-and-more-january-6-2025/ <![CDATA[Prasad Rao]]> Mon, 06 Jan 2025 18:12:56 +0000 <![CDATA[Amazon Bedrock]]> <![CDATA[Amazon SageMaker JumpStart]]> <![CDATA[Announcements]]> <![CDATA[Billing & Account Management]]> <![CDATA[Launch]]> <![CDATA[News]]> <![CDATA[Week in Review]]> 4fa89b3af496404ca2ee8f7c6b9813035cee90e6 Happy New Year! We are witnessing technology augment human ingenuity in inspiring ways. In the coming years, using technology for positive impact will redefine the way we think about success. Amazon CTO, Dr. Werner Vogels, offers five forward-looking tech predictions for 2025, and beyond: The workforce of tomorrow is mission-driven A new era of energy […] <p>Happy New Year! We are witnessing technology augment human ingenuity in inspiring ways. In the coming years, using technology for positive impact will redefine the way we think about success. Amazon CTO, Dr. Werner Vogels, offers five forward-looking tech predictions for 2025, and beyond:<a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/03/WV.png"><img loading="lazy" class="wp-image-93206 size-medium alignright" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2025/01/03/WV-232x300.png" alt="" width="232" height="300"></a></p> <ul> <li>The workforce of tomorrow is mission-driven</li> <li>A new era of energy efficiency drives innovation</li> <li>Technology tips the scales in the discovery of truth</li> <li>Open data drives decentralized disaster preparedness</li> <li>Intention-driven consumer technology takes hold</li> </ul> <p>Download the Werner Vogels’ <a href="https://d1.awsstatic.com/executive-insights/en_US/werner_vogels_tech_predictions_for_2025_and_beyond_ebook.pdf">Tech Predictions for 2025 and Beyond ebook,</a> or read Werner’s <a href="https://www.allthingsdistributed.com/2024/12/tech-predictions-for-2025-and-beyond.html">All Things Distributed blog</a> to learn more about how these technological trends are shaping our world and paving the way for a more innovative, efficient, and purposeful future.</p> <p><span style="text-decoration: underline;"><strong>AWS re:Invent 2025 videos and re:Caps</strong></span><br> If you’re looking to catch up on re:Invent announcements or delve deeper into the latest AWS innovations, you have several options available:</p> <ul> <li><a href="https://reinvent.awsevents.com/on-demand/">Watch the keynotes, innovation talks, and breakout sessions</a> on-demand.</li> <li><a href="https://community.aws/recaps?postLogin=downloadPDF">Download the summary of key AWS re:Invent announcements.</a></li> <li>Attend <a href="https://community.aws/recaps">free in-person community re:Cap sessions</a> organized by volunteers from <a href="https://aws.amazon.com/developer/community/usergroups/">AWS User Groups</a> around the world.</li> </ul> <p><span style="text-decoration: underline;"><strong>Launches from the last few weeks</strong></span><br> Since our <a href="https://aws.amazon.com/blogs/aws/aws-weekly-roundup-amazon-ec2-f2-instances-amazon-bedrock-guardrails-price-reduction-amazon-ses-update-and-more-december-16-2024/">last week in review</a> on December 16, 2024, I’d like to highlight some launches from year end, as well as from last week:</p> <p><a href="https://aws.amazon.com/blogs/machine-learning/llama-3-3-70b-now-available-in-amazon-sagemaker-jumpstart/">Availability of Llama 3.3 70B in Amazon SageMaker JumpStart</a> and in <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/metas-llama-3-3-70b-model-amazon-bedrock/">Amazon Bedrock</a>&nbsp;–&nbsp;Meta’s&nbsp;<a href="https://www.llama.com/docs/model-cards-and-prompt-formats/llama3_3/">Llama 3.3 70B</a> represents a significant advancement in model efficiency and performance optimization. Llama 3.3 70B is a text-only instruction-tuned model that provides enhanced performance relative to <a href="https://www.llama.com/docs/model-cards-and-prompt-formats/llama3_1">Llama 3.1 70B</a> and <a href="https://www.llama.com/docs/model-cards-and-prompt-formats/llama3_2">Llama 3.2 90B</a>, when used for text-only applications. You can now use the model in both <a href="https://aws.amazon.com/sagemaker-ai/jumpstart/">Amazon SageMaker JumpStart,</a> as well as <a href="https://aws.amazon.com/bedrock/">Amazon Bedrock</a>.</p> <p><a href="https://aws.amazon.com/blogs/aws/stable-diffusion-3-5-large-is-now-available-in-amazon-bedrock/">Availability of Stable Diffusion 3.5 Large in Amazon Bedrock</a> –&nbsp;<a href="https://stability.ai/news/introducing-stable-diffusion-3-5">Stable Diffusion 3.5 Large</a> by <a href="https://stability.ai/">Stability AI</a> is the most powerful model in the Stable Diffusion family at 8.1 billion parameters trained on <a href="https://aws.amazon.com/sagemaker-ai/hyperpod/">Amazon SageMaker HyperPod</a>. You can now use <a href="https://aws.amazon.com/bedrock/stability-ai/">Stable Diffusion 3.5 Large in Amazon Bedrock</a> to generate high-quality images from text descriptions.</p> <p><a href="https://aws.amazon.com/blogs/big-data/introducing-the-new-amazon-kinesis-source-connector-for-apache-flink/">New Amazon Kinesis source connector for Apache Flink</a>&nbsp;–&nbsp;The <a href="https://flink.apache.org/">Apache Flink</a> community has released version 5.0.0 of AWS services connectors, an AWS open source contribution. This release introduces the <a href="https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/connectors/datastream/kinesis/#kinesis-streams-source">Kinesis Streams Source</a>, a new connector for reading data from <a href="https://aws.amazon.com/kinesis/data-streams/">Amazon Kinesis Data Streams</a>, replacing the previous <a href="https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/connectors/datastream/kinesis/#kinesis-consumer">Kinesis Consumer</a>.</p> <p><a href="https://aws.amazon.com/blogs/desktop-and-application-streaming/announcing-support-for-amazon-workspaces-personal-with-aws-global-accelerator/">Support of AWS Global Accelerator in Amazon WorkSpaces Personal</a> – <a href="https://aws.amazon.com/workspaces-family/workspaces/features/personal/">Amazon WorkSpaces Personal</a> now integrates with&nbsp;<a href="https://aws.amazon.com/global-accelerator/">AWS Global Accelerator (AGA)</a>&nbsp;to enhance WorkSpaces connection performance by optimizing streaming traffic through the <a href="https://aws.amazon.com/about-aws/global-infrastructure/">AWS Global Network and edge locations</a>. This feature particularly benefits customers whose end users connect to WorkSpaces across long distances. You can enable the AGA feature at either the WorkSpaces directory level or for individual WorkSpaces running&nbsp;<a href="https://docs.aws.amazon.com/dcv/latest/adminguide/what-is-dcv.html">Amazon DCV protocol</a>.</p> <p><a href="https://aws.amazon.com/blogs/mt/aws-launches-enhanced-aws-resource-explorer-features-for-new-resource-insights/">New resource insights in AWS Resource Explorer</a>&nbsp;–&nbsp;With the enhanced Resource Explorer experience, relevant data and insights from multiple AWS services is centralized for <a href="https://docs.aws.amazon.com/resource-explorer/latest/userguide/supported-resource-types.html">supported resource types</a>. You can use the new features to take actions on resources directly from the Resource Explorer console, such as manage tags, add resources to applications, and get additional information about a resource with <a href="https://aws.amazon.com/q/">Amazon Q</a>.</p> <p><a href="https://aws.amazon.com/blogs/aws-cloud-financial-management/introducing-custom-billing-views-tailored-cost-and-usage-view-relevant-for-your-stakeholders/">General availability of custom billing view in AWS Billing and Cost Management</a>&nbsp;–&nbsp;<a href="https://docs.aws.amazon.com/cost-management/latest/userguide/billing-view.html">Custom billing view</a> allows you to provide application and business unit owners access to relevant cost management data across multiple AWS accounts using a single view in <a href="https://docs.aws.amazon.com/cost-management/latest/userguide/ce-getting-started.html">AWS Cost Explorer</a> without granting access to the <a href="https://docs.aws.amazon.com/managedservices/latest/userguide/management-account.html">AWS management account</a>. You can create filtered views of cost management data based on cost allocation tags or specific AWS accounts.</p> <p><a href="https://aws.amazon.com/new/">For a full list of AWS announcements, be sure to keep an eye on the What’s New at AWS page.</a></p> <p><span style="text-decoration: underline;"><strong>Upcoming AWS events</strong></span><br> Check your calendars and sign up for these AWS events:</p> <p><a href="https://aws.amazon.com/automotive/ces-2025/">AWS at CES 2025</a> (January 7-10) – AWS will be representing some of the latest cloud services and solutions that are purpose built for the automotive, mobility, transportation, and manufacturing industries. Join us to learn about the latest cloud capabilities across generative AI, software define vehicles, product engineering, sustainability, new digital customer experiences, connected mobility, autonomous driving, and so much more, in&nbsp;<a href="https://developer.amazon.com/ces">Amazon Experience Area</a>.</p> <p><a href="https://aws.amazon.com/retail/nrf-2025/">AWS at NRF 2025</a> (January 12-14) – Join AWS at the retail’s big show to see generative AI and cutting-edge technologies in action. Listen to innovative big ideas sessions, curated TechTalks, and experience the latest in retail trends, technologies, and more.</p> <p><a href="https://aws.amazon.com/blogs/business-intelligence/january-2025-amazon-quicksight-events/">Amazon QuickSight Learning Series</a> – Kick off your 2025 by supercharging your data skills. Join the online Learning Series in January to learn about the cutting-edge&nbsp;<a href="https://community.amazonquicksight.com/c/reinvent/quicksight-reinvent/32">features of Amazon QuickSight unveiled at re:Invent 2024</a>.</p> <p><a href="https://aws.amazon.com/events/explore-aws-events/">You can browse all upcoming in-person and virtual events.</a></p> <p>That’s all for this week. Check back next Monday for another Weekly Roundup!</p> <p>–<a href="https://www.linkedin.com/in/kprasadrao/">Prasad</a></p> <p><em>This post is part of our&nbsp;<a href="https://aws.amazon.com/blogs/aws/tag/week-in-review/">Weekly Roundup&nbsp;series</a>. Check back each week for a quick roundup of interesting news and announcements from AWS!</em></p> Stable Diffusion 3.5 Large is now available in Amazon Bedrock https://aws.amazon.com/blogs/aws/stable-diffusion-3-5-large-is-now-available-in-amazon-bedrock/ <![CDATA[Channy Yun (윤석찬)]]> Thu, 19 Dec 2024 19:22:10 +0000 <![CDATA[Amazon Bedrock]]> <![CDATA[Announcements]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> d9bc4ab0950931ef589e91784abcf2b095b29367 Unleash your creativity: Stable Diffusion 3.5 Large in Amazon Bedrock generates stunning high-resolution images with superior detail, style variety, and prompt adherence for accelerated visual content creation. <p>As we preannounced at AWS re:Invent 2024, you can now use <a href="https://aws.amazon.com/bedrock/stability-ai/">Stable Diffusion 3.5 Large in Amazon Bedrock</a> to generate high-quality images from text descriptions in a wide range of styles to accelerate the creation of concept art, visual effects, and detailed product imagery for customers in media, gaming, advertising, and retail.</p> <p>In October 2024, <a href="https://stability.ai/">Stability AI</a> introduced <a href="https://stability.ai/news/introducing-stable-diffusion-3-5">Stable Diffusion 3.5 Large</a>, the most powerful model in the Stable Diffusion family at 8.1 billion parameters trained on <a href="https://aws.amazon.com/sagemaker-ai/hyperpod/">Amazon SageMaker HyperPod</a>, with superior quality and prompt adherence. Stable Diffusion 3.5 Large can accelerate storyboarding, concept art creation, and rapid prototyping of visual effects. You can quickly generate high-quality 1-megapixel images for campaigns, social media posts, and advertisements, saving time and resources while maintaining creative control.</p> <p>Stable Diffusion 3.5 Large offers users nearly endless creative possibilities, including:</p> <ul> <li><strong>Versatile Styles</strong> – You can generate images in a wide range of styles and aesthetics, including 3-dimentional, photography, painting, line art, and virtually any visual style you can imagine.</li> <li><strong>Prompt Adherence</strong> – You can use Stable Diffusion 3.5 Large’s advanced prompt adherence to closely follow your text prompts, making it a top choice for efficient, high-quality performance.</li> <li><strong>Diverse Outputs</strong> – You can create images representative of the diverse world around you, featuring people with different skin tones and features, without the need for extensive prompting.</li> </ul> <p>Today, Stable Image Ultra in Amazon Bedrock has been updated to include Stable Diffusion 3.5 Large in the model’s underlying architecture. Stable Image Ultra, powered by Stability AI’s most advanced models, including Stable Diffusion 3.5, sets a new standard in image generation. It excels in typography, intricate compositions, dynamic lighting, vibrant colors, and artistic cohesion.</p> <p>With the latest update of Stable Diffusion models in <a href="https://aws.amazon.com/bedrock/">Amazon Bedrock</a>, you have a broader set of solutions to boost your creativity and accelerate image generation workflows.</p> <p><u><strong>Get started with Stable Diffusion 3.5 Large in Amazon Bedrock</strong></u><br> Before getting started, if you are new to using Stability AI models, go to the <a href="https://us-west-2.console.aws.amazon.com/bedrock/home?region=us-west-2#modelaccess">Amazon Bedrock console</a> and choose <strong>Model access</strong> on the bottom left pane. To access the latest Stability AI models, request access for <strong>Stable Diffusion 3.5 Large</strong> in Stability AI.</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93105" style="width: 95%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/14/2024-sd35-bedrock-1-model-access.png" alt="" width="1840" height="1247"></p> <p>To test the Stability AI models in Amazon Bedrock, choose <strong>Image </strong>under <strong>Playgrounds </strong>in the left menu pane. Then choose <strong>Select model</strong> and select <strong>Stability AI</strong> as the category and <strong>Stable Diffusion 3.5 Large </strong>as the model.</p> <p><img loading="lazy" class="aligncenter wp-image-93118 size-full" style="width: 95%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/16/2024-sd35-bedrock-2-select-model-1.png" alt="" width="1752" height="1127"></p> <p>You can generate an image with your prompt. Here is a sample prompt to generate the image:</p> <p><code>High-energy street scene in a neon-lit Tokyo alley at night, where steam rises from food carts, and colorful neon signs illuminate the rain-slicked pavement.</code></p> <p><img loading="lazy" class="aligncenter size-full wp-image-93107" style="width: 95%;border: solid 1px #ccc" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/14/2024-sd35-bedrock-3-play-ground.jpg" alt="" width="1856" height="1344"></p> <p>By choosing <strong>View API request</strong>, you can also access the model using code examples in the <a href="https://aws.amazon.com/cli/">AWS Command Line Interface (AWS CLI)</a> and <a href="https://aws.amazon.com/developer/tools/">AWS SDKs</a>. You can use <code>stability.sd3-5-large-v1:0</code> as the model ID.</p> <p>To get the image with a single command, I write the output JSON file to standard output and use the <a href="https://jqlang.github.io/jq/">jq</a> tool to extract the encoded image so that it can be decoded on the fly. The output is written in the img.png file.</p> <p>Here is a sample of the AWS CLI command:</p> <pre><code class="lang-bash">$ aws bedrock-runtime invoke-model \ --model-id stability.sd3-5-large-v1:0 \ --body "{\"prompt\":\"High-energy street scene in a neon-lit Tokyo alley at night, where steam rises from food carts, and colorful neon signs illuminate the rain-slicked pavement.\",\"mode\":\"text-to-image\",\"aspect_ratio\":\"1:1\",\"output_format\":\"jpeg\",\"seed\":0}" \ --cli-binary-format raw-in-base64-out \ --region us-west-2 \ /dev/stdout | jq -r '.images[0]' | base64 --decode &gt; img.jpg</code></pre> <p>Here’s how you can use Stable Image Ultra 1.1 to include Stable Diffusion 3.5 Large in the model’s underlying architecture with the <a href="https://aws.amazon.com/sdk-for-python/">AWS SDK for Python (Boto3)</a>. This simple application interactively asks for a text-to-image prompt and then calls Amazon Bedrock to generate the image with <code>stability.stable-image-ultra-v1:1</code> as the model ID.</p> <pre><code class="lang-python">import base64 import boto3 import json import os MODEL_ID = "stability.stable-image-ultra-v1:1" bedrock_runtime = boto3.client("bedrock-runtime", region_name="us-west-2") print("Enter a prompt for the text-to-image model:") prompt = input() body = { "prompt": prompt, "mode": "text-to-image" } response = bedrock_runtime.invoke_model(modelId=MODEL_ID, body=json.dumps(body)) model_response = json.loads(response["body"].read()) base64_image_data = model_response["images"][0] i, output_dir = 1, "output" if not os.path.exists(output_dir): os.makedirs(output_dir) while os.path.exists(os.path.join(output_dir, f"img_{i}.png")): i += 1 image_data = base64.b64decode(base64_image_data) image_path = os.path.join(output_dir, f"img_{i}.png") with open(image_path, "wb") as file: file.write(image_data) print(f"The generated image has been saved to {image_path}")</code></pre> <p>The application writes the resulting image in an <code>output</code> directory that is created if not present. To not overwrite existing files, the code checks for existing files to find the first file name available with the <code>img_&lt;number&gt;.png</code> format.</p> <p>To learn more, visit the <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/bedrock-runtime_example_bedrock-runtime_InvokeModel_StableDiffusion_section.html">Invoke API examples</a> using AWS SDKs to build your applications to generate an image using various programming languages.</p> <p><strong><u>Interesting examples</u></strong><br> Here are a few images created with Stable Diffusion 3.5 Large.</p> <table> <tbody> <tr> <td width="347"><img loading="lazy" class="aligncenter wp-image-93173 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/19/Full-body-university-students-working-on-a-tech-project-with-the-words-_Stable-Diffusion-3.5-in-Amazon-Bedrock_-cheerful-cursive-typography-font-in-the-foreground.jpeg" alt="" width="1024" height="1024"></td> <td width="347"><img loading="lazy" class="aligncenter size-full wp-image-93147" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/17/photo-of-three-potions.jpeg" alt="" width="1024" height="1024"></td> </tr> <tr> <td width="347"><code><strong>Prompt:</strong> Full-body university students working on a tech project with the words Stable Diffusion 3.5 in Amazon Bedrock, cheerful cursive typography font in the foreground.<br> </code></td> <td width="347"><code><strong>Prompt:</strong> Photo of three potions: the first potion is blue with the label "MANA", the second potion is red with the label "HEALTH", the third potion is green with the label "POISON". Old apothecary.</code></td> </tr> <tr> <td width="347"><img loading="lazy" class="aligncenter size-full wp-image-93148" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/17/Photography-pink-rose-flowers.jpg" alt="" width="1024" height="1024"></td> <td width="347"><strong><img loading="lazy" class="aligncenter size-full wp-image-93149" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/17/3D-animation-scene.jpeg" alt="" width="1024" height="1024"></strong></td> </tr> <tr> <td width="347"><code></code><code><strong>Prompt:</strong> Photography, pink rose flowers in the twilight, glowing, tile houses in the background.</code></td> <td width="347"><code><strong>Prompt:</strong> 3D animation scene of an adventurer traveling the world with his pet dog.</code></td> </tr> </tbody> </table> <p><u><strong>Now available</strong><br> </u>Stable Diffusion 3.5 Large model is generally available today in Amazon Bedrock in the US West (Oregon) <a href="https://docs.aws.amazon.com/glossary/latest/reference/glos-chap.html#region">AWS Region</a>. Check the <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/models-regions.html">full Region list</a> for future updates. To learn more, check out the <a href="https://aws.amazon.com/bedrock/stability-ai/">Stability AI in Amazon Bedrock</a> product page and the <a href="https://aws.amazon.com/bedrock/pricing/">Amazon Bedrock Pricing</a> page.</p> <p>Give Stable Diffusion 3.5 Large a try in the <a href="https://console.aws.amazon.com/bedrock">Amazon Bedrock console</a> today and send feedback to <a href="https://repost.aws/tags/TAQeKlaPaNRQ2tWB6P7KrMag/amazon-bedrock">AWS re:Post for Amazon Bedrock</a> or through your usual AWS Support contacts.</p> <p>— <a href="https://twitter.com/channyun">Channy</a></p> <p><i><strong>Updated on Dec 19, 2024</strong> — Fixed AWS CLI command to invoke the model.</i></p> New Amazon EC2 High Memory U7inh instance on HPE Server for large in-memory databases https://aws.amazon.com/blogs/aws/new-amazon-ec2-high-memory-u7inh-instance-on-hpe-server-for-large-in-memory-databases/ <![CDATA[Channy Yun (윤석찬)]]> Mon, 16 Dec 2024 20:30:18 +0000 <![CDATA[Amazon EC2]]> <![CDATA[Announcements]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> 14aea61aa94665071e4b352fb1ccf17580bf8876 Leverage 1920 vCPUs and 32TB memory with high-performance U7inh instances from AWS, powered by Intel Xeon Scalable processors; seamlessly migrate SAP HANA and other mission-critical workloads while benefiting from cloud scalability and cost savings. <p>Today we’re announcing the general availability of <a href="https://aws.amazon.com/ec2">Amazon Elastic Compute Cloud (Amazon EC2)</a> <a href="https://aws.amazon.com/ec2/instance-types/u7i/">U7inh instance</a>, a new addition to EC2 High Memory family, built in collaboration with Hewlett Packard Enterprise (HPE). Amazon EC2 U7inh instance runs on the 16-socket HPE Compute Scale-up Server 3200, and are built on the <a href="https://aws.amazon.com/ec2/nitro/">AWS Nitro System</a> to deliver a fully integrated and managed experience consistent with other EC2 instances.</p> <p>Powered by the fourth generation Intel<sup>®</sup> Xeon<sup>®</sup> Scalable processors (Sapphire Rapids), U7inh instance supports 32 TB of memory and 1920 vCPUs. This instance offers the highest compute performance, largest compute and memory size in the <a href="https://aws.amazon.com/">Amazon Web Services (AWS)</a> Cloud for running large, mission-critical database workloads, like SAP HANA.</p> <p>In May 2024, we launched <a href="https://aws.amazon.com/blogs/aws/amazon-ec2-high-memory-u7i-instances-for-large-in-memory-databases/">U7i instances</a> to support up to 896 vCPUs and up to 32 TB of memory, which our enterprise customers could use to successfully migrate their large mission-critical in-memory databases to AWS and benefit from the flexibility, scalability, reliability, and cost advantages that AWS offers.</p> <p>As customers continue to scale their business applications, they wanted the performance combined with the additional CPUs and memory along with SAP certification to generate real-time business insights. Other customers that currently run on-premises with HPE servers have also asked how we can help them migrate to AWS to take advantage of cloud benefits while continuing to use HPE hardware.</p> <p>Here are the detailed specs of new U7inh instance:</p> <table style="border: 2px solid black; border-collapse: collapse; margin-left: auto; margin-right: auto; height: 67px;"> <tbody> <tr style="border-bottom: 1px solid black; background-color: #e0e0e0;"> <td style="border-right: 1px solid black; padding: 4px; text-align: center;"><strong>Instance name</strong></td> <td style="border-right: 1px solid black; padding: 4px; text-align: center;"><strong>vCPUs</strong></td> <td style="border-right: 1px solid black; padding: 4px; text-align: center;"><strong>Memory (DDR5)</strong></td> <td style="border-right: 1px solid black; padding: 4px; text-align: center;"><strong>EBS bandwidth</strong></td> <td style="border-right: 1px solid black; padding: 4px; text-align: center;"><strong>Network bandwidth</strong></td> </tr> <tr style="border-bottom: 1px solid black;"> <td style="border-right: 1px solid black; padding: 4px; text-align: center;"><strong>U7inh-32tb.480xlarge</strong></td> <td style="border-right: 1px solid black; padding: 4px; text-align: center;">1920</td> <td style="border-right: 1px solid black; padding: 4px; text-align: center;">32,768 GiB</td> <td style="border-right: 1px solid black; padding: 4px; text-align: center;">160 Gbps</td> <td style="border-right: 1px solid black; padding: 4px; text-align: center;">200 Gbps</td> </tr> </tbody> </table> <p>U7inh instance offers up to two times vCPUs and 1.6 times EBS bandwidth in a single instance, compared with the largest U7i instance. You can run your largest in-memory database workloads like SAP HANA or seamlessly migrate workloads running on HPE hardware to AWS.</p> <p>U7inh instance supports Amazon Linux, Red Hat Enterprise Linux, and SUSE Enterprise Linux Server. Operating system support for SAP HANA workloads on High Memory instances include: SUSE Linux Enterprise Server 15 SP3 for SAP and above and Red Hat Enterprise Linux 8.6/9.0 for SAP and above.</p> <p>U7inh instance is SAP certified to run Business Suite on HANA (SoH), Business Suite S/4HANA, Business Warehouse on HANA (BW), and SAP BW/4HANA in production environments. U7inh instance is also certified for scale-out SAP HANA OLTP workloads such as S/4HANA and customers can deploy up to four U7inh instance (128TB) in a cluster for even larger SAP HANA workloads.</p> <p>To learn more about how to migrate, visit&nbsp;<a href="https://docs.aws.amazon.com/sap/latest/sap-hana/migrating-hana-to-hm.html">Migrating SAP HANA on AWS to an EC2 High Memory Instance</a> in the SAP HANA on AWS Guides and <a href="https://docs.aws.amazon.com/launchwizard/latest/userguide/launch-wizard-sap.html">AWS Launch Wizard for SAP</a> in the AWS Launch Wizard User Guide.</p> <p><u><strong>Now available</strong></u><br> Amazon EC2 U7inh instance is available in the US East (N. Virginia) and US West (Oregon) <a href="https://docs.aws.amazon.com/glossary/latest/reference/glos-chap.html#region">AWS Regions</a>.</p> <p>To learn more, visit the <a href="https://aws.amazon.com/ec2/instance-types/u7i/">U7i instance product page</a> and send feedback to <a href="https://repost.aws/tags/TAO-wqN9fYRoyrpdULLa5y7g/amazon-ec-2">AWS re:Post for EC2</a> or through your usual AWS Support contacts.</p> <p>— <a href="https://twitter.com/channyun">Channy</a></p> And that’s a wrap! https://aws.amazon.com/blogs/aws/and-thats-a-wrap/ <![CDATA[Jeff Barr]]> Mon, 16 Dec 2024 17:16:46 +0000 <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> 7b5d66570efffb6adcce029ab8c444bf7cd32f79 After 20 years, and 3283 posts adding up to 1,577,106 words I am wrapping up my time as the lead blogger on the AWS News Blog. It has been a privilege to be able to “live in the future” and to get to learn and write about so many of our innovations over the last […] <p>After 20 years, and 3283 posts adding up to 1,577,106 words I am wrapping up my time as the lead blogger on the AWS News Blog.</p> <p>It has been a privilege to be able to “live in the future” and to get to learn and write about so many of our innovations over the last two decades: <a href="https://aws.amazon.com/blogs/aws/amazon_simple_q/">message queuing</a>, <a href="https://aws.amazon.com/blogs/aws/amazon_s3/">storage</a>, <a href="https://aws.amazon.com/blogs/aws/amazon_ec2_beta/">on-demand computing</a>, <a href="https://aws.amazon.com/blogs/aws/run-code-cloud/">serverless</a>, and <a href="https://aws.amazon.com/blogs/aws/amazon-braket-get-started-with-quantum-computing/">quantum computing</a> to name just a few and to leave many others out. It has also been a privilege to be able to meet and to hear from so many of you that have faithfully read and (hopefully) learned from my content over the years. I treasure those interactions and your kind words, and I keep both in mind when I write.</p> <p><span style="text-decoration: underline"><strong>Next for Jeff<br> </strong></span>I began my career as a builder. Over the years I have written tens of thousands of lines of assembly code (6502, Z80, and 68000), Visual Basic, and PHP, along with hundreds of thousands of lines of C. However, over the years I’ve progressively spent less time building and more time talking about building. As each new service and feature whizzed past my eyes I would reminiscence about days and decades past, when I could actually use these goodies to create something cool. I went from being a developer who could market, to a marketer who used to be able to develop. There’s absolutely nothing wrong with that, but I like to build. The medium could be code, 3D printing, LEGO bricks, electronics components, or even cardboard –creating and innovating is what motivates and sustains me.</p> <p>With that as my driving force, my goal for the next step of my career at AWS is to invest more time focused on learning and using fewer things, building cool stuff, and creating fresh, developer-focused content as I do so. I’m still working to figure out the form that this will take, so stay tuned. I am also going to continue to make my weekly appearances at <a href="https://aws.amazon.com/developer/community/live-video/aws-on-air/">AWS OnAir</a> (our Friday Twitch show), and I will continue to speak at AWS community events around the globe.</p> <p><span style="text-decoration: underline"><strong>Next for the Blog</strong></span><br> As for the AWS News Blog, it has long been backed by an awesome team, both visible and invisible. Here we are at the recent <a href="https://reinvent.awsevents.com/">AWS re:Invent</a> celebration of the blog’s 20th anniversary (photo courtesy of <a href="https://www.linkedin.com/in/lizfue/">Liz Fuentes</a> with edits by <a href="https://www.linkedin.com/in/channy/?originalSubdomain=kr">Channy Yun</a> to add those who were otherwise occupied):</p> <p><img loading="lazy" class="aligncenter size-full wp-image-93063" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/12/blog_ri_20_all-1.jpg" alt="" width="900" height="675"></p> <p>During the celebration I told the team that I look forward to celebrating the 30 year anniversary with them at re:Invent 2034.</p> <p>Going forward, the team will continue to grow and the goal remains the same: to provide our customers with carefully chosen, high-quality information about the latest and most meaningful AWS launches. The blog is in great hands and this team will continue to keep you informed even as the AWS pace of innovation continues to accelerate.</p> <p><span style="text-decoration: underline"><strong>Thanks Again</strong></span><br> Once again I need to thank all of you for the very kind words and gestures over the years. Once in your life, if you work hard and get really lucky, you get a unique opportunity to do something that really and truly matters to people. And I have been lucky.</p> <p></p> <p>— <a href="https://twitter.com/jeffbarr">Jeff</a>;</p> <p></p> AWS Weekly Roundup: Amazon EC2 F2 instances, Amazon Bedrock Guardrails price reduction, Amazon SES update, and more (December 16, 2024) https://aws.amazon.com/blogs/aws/aws-weekly-roundup-amazon-ec2-f2-instances-amazon-bedrock-guardrails-price-reduction-amazon-ses-update-and-more-december-16-2024/ <![CDATA[Danilo Poccia]]> Mon, 16 Dec 2024 14:47:40 +0000 <![CDATA[Amazon Bedrock]]> <![CDATA[Amazon Bedrock Guardrails]]> <![CDATA[Amazon EC2]]> <![CDATA[Amazon Simple Email Service (SES)]]> <![CDATA[Announcements]]> <![CDATA[Launch]]> <![CDATA[News]]> <![CDATA[Week in Review]]> 7a4166e9acce557cab34dfe6b39d974c819d3d39 The week after AWS re:Invent builds on the excitement and energy of the event and is a good time to learn more and understand how the recent announcements can help you solve your challenges. As usual, we have you covered with our top announcements of AWS re:Invent 2024 post. You can now watch keynotes and […] <p>The week after <a href="https://reinvent.awsevents.com/">AWS re:Invent</a> builds on the excitement and energy of the event and is a good time to learn more and understand how the recent announcements can help you solve your challenges. As usual, we have you covered with our <a href="https://aws.amazon.com/blogs/aws/top-announcements-of-aws-reinvent-2024/">top announcements of AWS re:Invent 2024 post</a>.</p> <p>You can now watch keynotes and sessions on the <a href="https://www.youtube.com/@AWSEventsChannel">AWS Event YouTube channel</a>. This year <a href="https://www.linkedin.com/in/andy-jassy-8b1615/">Andy Jassy,</a> now President and CEO at Amazon, <a href="https://www.youtube.com/playlist?list=PLhr1KZpdzukcqPKhvTp5Dm2wMdmubETnC">returned to re:Invent and shared some thoughts in these videos</a>.</p> <p><iframe loading="lazy" title="AWS re:Invent 2024 - Andy Jassy Returns to re:Invent and its Origin Story | Amazon Web Services" width="500" height="281" src="https://www.youtube-nocookie.com/embed/moECYs9sH4g?list=PLhr1KZpdzukcqPKhvTp5Dm2wMdmubETnC" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen sandbox="allow-scripts allow-same-origin"></iframe></p> <p>Drawing on experiences Amazon has had building distributed systems at massive scale, <a href="https://www.allthingsdistributed.com/">Werner Vogels</a>, VP and CTO at Amazon, shared critical lessons and strategies he has learned for managing complex systems in <a href="https://youtu.be/aim5x73crbM?si=CYiQMUXNx92nC1hq">his keynote</a>.</p> <p><iframe loading="lazy" title="​​AWS re:Invent 2024 - Dr. Werner Vogels Keynote" width="500" height="281" src="https://www.youtube-nocookie.com/embed/aim5x73crbM?feature=oembed" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen sandbox="allow-scripts allow-same-origin"></iframe></p> <p><span style="text-decoration: underline;"><strong>Last week’s launches</strong></span><br> Here are the launches that got my attention.</p> <p><a href="https://aws.amazon.com/ec2/"><strong>Amazon Elastic Compute Cloud (Amazon EC2)</strong></a> – A <a href="https://aws.amazon.com/blogs/aws/now-available-second-generation-fpga-powered-amazon-ec2-instances-f2/">new generation of FPGA-powered instances (F2) is now available</a>. In contrast to a purpose-built chip designed with a single function in mind and then hard-wired to implement it, a field programmable gate array (FPGA) can be programmed in the field, after it has been plugged in to a socket on a PC board. We’re also <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-ec2-u7i-instances-6tib-8tib-memory/">introducing Amazon EC2 High Memory U7i instances</a> with 6TiB and 8TiB of memory. U7i instances are ideal to run large in-memory databases such as SAP HANA, Oracle, and SQL Server. Graviton-based 8th generation instances now <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-ec2-instances-bandwidth-configurations-vpc-ebs/">support bandwidth configurations for Amazon VPC and Amazon EBS</a>.</p> <p><a href="https://aws.amazon.com/bedrock/guardrails/"><strong>Amazon Bedrock Guardrails</strong></a> – We are <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-bedrock-guardrails-reduces-pricing-85-percent/">reducing pricing by up to 85%</a> to help you implement safeguards for your <a href="https://aws.amazon.com/ai/generative-ai/">generative AI</a> applications. Also, we’re adding <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-bedrock-guardrails-languages-spanish-french/">multilingual capabilities</a> with support for Spanish and French languages.</p> <p><a href="https://aws.amazon.com/ses/"><strong>Amazon Simple Email Services (SES)</strong></a>&nbsp;– Now offers <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-ses-global-endpoints-multiregion-sending-resilience/">Global Endpoints for multi-region sending resilience</a> and announces the <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-simple-email-services-deterministic-easy-dkim/">availability of Deterministic Easy DKIM (DEED)</a>, a new form of global identity which simplifies the use of DomainKeys Identified Mail (DKIM) management.</p> <p><a href="https://aws.amazon.com/cloudformation/"><strong>AWS CloudFormation</strong></a> – An enhanced version of the <a href="https://aws.amazon.com/secrets-manager/">AWS Secrets Manager</a> <a href="https://aws.amazon.com/blogs/security/introducing-an-enhanced-version-of-the-aws-secrets-manager-transform-awssecretsmanager-2024-09-16/">transform introducing automatic</a> <a href="https://aws.amazon.com/lambda/">AWS Lambda</a> upgrades.</p> <p><a href="https://aws.amazon.com/lex/"><strong>Amazon Lex</strong></a> – Launches new <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-lex-multilingual-speech-recognition-models/">multilingual streaming speech recognition models</a> that enhance recognition accuracy through two specialized groupings: a European-based model (for Portuguese, Catalan, French, Italian, German, and Spanish) and a Asia Pacific-based model (for Chinese, Korean, and Japanese).</p> <p><a href="https://aws.amazon.com/connect/"><strong>Amazon Connect</strong></a> – Now <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-connect-push-notifications-mobile-chat/">supports push notifications for mobile chat</a> on iOS and Android devices. In this way, you can be proactively notified as soon as there is a new message from an agent or chatbot, even when not actively chatting. You can now also <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-connect-holiday-overrides-hours-operation/">configure holidays and other variances to your contact center hours of operation</a>.</p> <p><a href="https://aws.amazon.com/security-hub/"><strong>AWS Security Hub</strong></a> – Now <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/aws-security-hub-pci-dss-v4.0-1-standard/">supports automated security checks aligned to the Payment Card Industry Data Security Standard (PCI DSS) v4.0.1</a>, a compliance framework that provides a set of rules and guidelines for safely handling credit and debit card information.</p> <p><a href="https://aws.amazon.com/resourceexplorer/"><strong>AWS Resource Explorer</strong></a> – <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/aws-resource-explorer-new-resource-types/">Supports 59 new resource types</a> including <a href="https://aws.amazon.com/eks/">Amazon Elastic Kubernetes Service (Amazon EKS)</a>, <a href="https://aws.amazon.com/kendra/">Amazon Kendra</a>, <a href="https://aws.amazon.com/iam/access-analyzer/">AWS Identity and Access Management (IAM) Access Analyzer</a>, and <a href="https://aws.amazon.com/sagemaker/">Amazon SageMaker</a>.</p> <p><strong>Amazon SageMaker AI</strong> – Inference optimized Amazon EC2 G6e instances (powered by <a href="https://aws.amazon.com/nvidia/">NVIDIA</a> L40S Tensor Core GPUs) and P5e (powered by NVIDIA H200 Tensor Core GPUs) are <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-sagemaker-ai-p5e-g6e-instances-inference/">now available on Amazon SageMaker</a>.</p> <p><a href="https://aws.amazon.com/redshift/"><strong>Amazon Redshift</strong></a> – Now <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-redshift-refresh-materialized-views-zero-etl-integrations/">supports automatically and incrementally refreshable materialized views on tables in a zero-ETL integration</a>. Previously, in this case, you had to run a full refresh.</p> <p><a href="https://aws.amazon.com/visualstudiocode/"><strong>AWS Toolkit for Visual Studio Code</strong></a> – Now <a href="https://aws.amazon.com/about-aws/whats-new/2024/12/aws-toolkit-visual-studio-code-cloudwatch-logs-live-tail/">includes Amazon CloudWatch Logs Live Tail</a>, an interactive log streaming and analytics capability that provides real-time visibility into your logs and makes it easier to develop and troubleshoot applications.</p> <p><span style="text-decoration: underline;"><strong>Other AWS news</strong></span><br> Here are some additional projects, blog posts, and news items that you might find interesting:</p> <p><strong><a href="https://aws.amazon.com/blogs/storage/build-a-managed-transactional-data-lake-with-amazon-s3-tables/">Build a managed transactional data lake with Amazon S3 Tables</a></strong> – Just introduced at re:Invent 2024, <a href="https://aws.amazon.com/s3/features/tables/">Amazon S3 Tables</a> is the first cloud object store with built-in <a href="https://iceberg.apache.org/">Apache Iceberg</a> support and the easiest way to store tabular data at scale. This <a href="https://aws.amazon.com/blogs/storage/build-a-managed-transactional-data-lake-with-amazon-s3-tables/">post on the AWS Storage Blog</a> provides an overview of S3 Tables and an example of how to build a transactional data lake with S3 Tables using <a href="https://spark.apache.org/">Apache Spark</a> on <a href="https://aws.amazon.com/emr/">Amazon EMR</a>.</p> <p><strong><a href="https://aws.amazon.com/blogs/networking-and-content-delivery/introducing-cross-region-connectivity-for-aws-privatelink/">Introducing Cross-Region Connectivity for AWS PrivateLink</a></strong> – More information on this recent launch that can be used to share and access <a href="https://aws.amazon.com/vpc/">Amazon Virtual Private Cloud (Amazon VPC)</a> endpoint services across different <a href="https://aws.amazon.com/about-aws/global-infrastructure/regions_az/">AWS Regions</a>.</p> <p><a href="https://www.linkedin.com/in/marc-brooker-b431772b/">Marc Brooker</a>, VP/Distinguished Engineer at AWS, shared on <a href="https://brooker.co.za/blog/">his personal blog</a> a few posts about what <a href="https://aws.amazon.com/rds/aurora/dsql/">Amazon Aurora DSQL</a> is, how it works, and how to make the best use of it:</p> <ul> <li><a href="https://brooker.co.za/blog/2024/12/03/aurora-dsql.html">DSQL Vignette: Aurora DSQL, and A Personal Story</a></li> <li><a href="https://brooker.co.za/blog/2024/12/04/inside-dsql.html">DSQL Vignette: Reads and Compute</a></li> <li><a href="https://brooker.co.za/blog/2024/12/05/inside-dsql-writes.html">DSQL Vignette: Transactions and Durability</a></li> <li><a href="https://brooker.co.za/blog/2024/12/06/inside-dsql-cap.html">DSQL Vignette: Wait! Isn’t That Impossible?</a></li> </ul> <p>That’s all for this week. Check back next Monday for another Weekly Roundup!</p> <p>— <a href="https://twitter.com/danilop">Danilo</a></p> <p><em>This post is part of our&nbsp;<a href="https://aws.amazon.com/blogs/aws/tag/week-in-review/">Weekly Roundup</a>&nbsp;series. Check back each week for a quick roundup of interesting news and announcements from AWS!</em></p> Now Available – Second-Generation FPGA-Powered Amazon EC2 instances (F2) https://aws.amazon.com/blogs/aws/now-available-second-generation-fpga-powered-amazon-ec2-instances-f2/ <![CDATA[Jeff Barr]]> Wed, 11 Dec 2024 23:09:48 +0000 <![CDATA[Amazon EC2]]> <![CDATA[Announcements]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> 823f176c71ff36d802a6912c8db66ae3c79403cf Accelerate genomics, multimedia, big data, networking, and more with up to 192 vCPUs, 8 FPGAs, 2TiB memory, and 100Gbps network – outpacing CPUs by up to 95x. <p><em>&nbsp;2/11/2025 update: Revised section on Genomics.</em></p> <p>Equipped with up to eight AMD Field-Programmable Gate Arrays (FPGAs), AMD EPYC (Milan) processors with up to 192 cores, High Bandwidth Memory (HBM), up to 8 TiB of SSD-based instance storage, and up to 2 TiB of memory, the new F2 instances are available in two sizes, and are ready to accelerate your genomics, multimedia processing, big data, satellite communication, networking, silicon simulation, and live video workloads.</p> <p><span style="text-decoration: underline;"><strong>A Quick FPGA Recap</strong></span><br> Here’s how I explained the FPGA model when we <a href="https://aws.amazon.com/blogs/aws/developer-preview-ec2-instances-f1-with-programmable-hardware/">previewed</a> the first generation of FPGA-powered <a href="https://aws.amazon.com/ec2/">Amazon Elastic Compute Cloud (Amazon EC2)</a> instances</p> <blockquote> <p>One of the more interesting routes to a custom, hardware-based solution is known as a Field Programmable Gate Array, or FPGA. In contrast to a purpose-built chip which is designed with a single function in mind and then hard-wired to implement it, an FPGA is more flexible. It can be programmed in the field, after it has been plugged in to a socket on a PC board. Each FPGA includes a fixed, finite number of simple logic gates. Programming an FPGA is “simply” a matter of connecting them up to create the desired logical functions (AND, OR, XOR, and so forth) or storage elements (flip-flops and shift registers). Unlike a CPU which is essentially serial (with a few parallel elements) and has fixed-size instructions and data paths (typically 32 or 64 bit), the FPGA can be programmed to perform many operations in parallel, and the operations themselves can be of almost any width, large or small.</p> </blockquote> <p>Since that launch, AWS customers have used F1 instances to host many different types of applications and services. With a newer FPGA, more processing power, and more memory bandwidth, the new F2 instances are an even better host for highly parallelizable, compute-intensive workloads.</p> <p>Each of the&nbsp;<a href="https://www.amd.com/en/products/adaptive-socs-and-fpgas/fpga/virtex-ultrascale-plus-hbm.html">AMD Virtex UltraScale+</a> HBM VU47P FPGAs has 2.85 million system logic cells and 9,024 DSP slices (up to 28 TOPS of DSP compute performance when processing INT8 values). The FPGA Accelerator Card associated with each F2 instance provides 16 GiB of High Bandwidth Memory and 64 GiB of DDR4 memory per FPGA.</p> <p><strong><span style="text-decoration: underline;">Inside the F2</span><br> </strong>F2 instances are powered by 3rd generation <a href="https://www.amd.com/en/products/processors/server/epyc/7003-series.html">AMD EPYC</a> (Milan) processors. In comparison to F1 instances, they offer up to 3x as many processor cores, up to twice as much system memory and NVMe storage, and up to 4x the network bandwidth. Each FPGA comes with 16 GiB High Bandwidth Memory (HBM) with up to 460 GiB/s bandwidth. Here are the instance sizes and specs:</p> <table style="margin-left: auto; margin-right: auto; border: 1px solid black; border-collapse: collapse;" cellpadding="8"> <tbody> <tr style="background-color: #e0e0e0; vertical-align: bottom;"> <td style="border-bottom: 1px solid black; text-align: center;"><strong>Instance Name</strong></td> <td style="border-bottom: 1px solid black; text-align: center;"><strong>vCPUs<br> </strong></td> <td style="border-bottom: 1px solid black; text-align: center;" align="center"><strong>FPGAs<br> </strong></td> <td style="border-bottom: 1px solid black; text-align: center;" align="center"><strong>FPGA Memory<br> HBM / DDR4<br> </strong></td> <td style="border-bottom: 1px solid black; text-align: center;" align="center"><strong>Instance Memory<br> </strong></td> <td style="border-bottom: 1px solid black; text-align: center;" align="center"><strong>NVMe Storage<br> </strong></td> <td style="border-bottom: 1px solid black; text-align: center;" align="center"><strong>EBS Bandwidth<br> </strong></td> <td style="border-bottom: 1px solid black; text-align: center;" align="center"><strong>Network Bandwidth<br> </strong></td> </tr> <tr style="border-bottom: 1px solid #ddd;"> <td align="left"><strong>f2.12xlarge</strong></td> <td align="center">48</td> <td align="center">2</td> <td align="center">32 GiB /<br> 128 GiB</td> <td align="center">512 GiB</td> <td align="center">1900 GiB<br> (2x 950 GiB)</td> <td align="center">15 Gbps</td> <td align="center">25 Gbps</td> </tr> <tr> <td align="left"><strong>f2.48xlarge</strong></td> <td align="center">192</td> <td align="center">8</td> <td align="center">128 GiB /<br> 512 GiB</td> <td align="center">2,048 GiB</td> <td align="center">7600 GiB<br> (8x 950 GiB)</td> <td align="center">60 Gbps</td> <td align="center">100 Gbps</td> </tr> </tbody> </table> <p>The high-end <strong>f2.48xlarge</strong> instance supports the <a href="https://aws.amazon.com/media-services/resources/cdi/">AWS Cloud Digital Interface</a> (CDI) to reliably transport uncompressed live video between applications, with instance-to-instance latency as low as 8 milliseconds.</p> <p><span style="text-decoration: underline;"><strong>Building FPGA Applications</strong></span><br> The <a href="https://github.com/aws/aws-fpga">AWS EC2 FPGA Development Kit</a> contains the tools that you will use to develop, simulate, debug, compile, and run your hardware-accelerated FPGA applications. You can launch the kit’s <a href="https://aws.amazon.com/marketplace/pp/prodview-f5kjsenkfkz5u">FPGA Developer AMI</a> on a memory-optimized or compute-optimized instance for development and simulation, then use an F2 instance for final debugging and testing.</p> <p>The tools included in the developer kit support a variety of development paradigms, tools, accelerator languages, and debugging options. Regardless of your choice, you will ultimately create an Amazon FPGA Image (AFI) which contains your custom acceleration logic and the <a href="https://github.com/aws/aws-fpga/blob/f2/hdk/docs/AWS_Shell_Interface_Specification.md">AWS Shell</a> which implements access to the FPGA memory, PCIe bus, interrupts, and external peripherals. You can deploy AFIs to as many F2 instances as desired, share with other AWS accounts or publish on AWS Marketplace.</p> <p>If you have already created an application that runs on F1 instances, you will need to update your development environment to use the latest AMD tools, then rebuild and validate before upgrading to F2 instances.</p> <p><span style="text-decoration: underline;"><strong>FPGA Instances in Action</strong></span><br> Here are some cool examples of how F1 and F2 instances can support unique and highly demanding workloads:</p> <p><strong>Genomics</strong> – Multinational pharmaceutical and biotechnology company AstraZeneca used thousands of F1 instances to build the world’s fastest genomics pipeline, able to process over 400K whole genome samples in under two months.</p> <p><strong>Satellite Communication</strong> – Satellite operators are moving from inflexible and expensive physical infrastructure (modulators, demodulators, combiners, splitters, and so forth) toward agile, software-defined, FPGA-powered solutions. Using the digital signal processor (DSP) elements on the FPGA, these solutions can be reconfigured in the field to support new waveforms and to meet changing requirements. Key F2 features such as support for up to 8 FPGAs per instance, generous amounts of network bandwidth, and support for the <a href="https://www.dpdk.org/">Data Plan Development Kit</a> (DPDK) using <a href="https://github.com/aws/aws-fpga/tree/f2/sdk/apps/virtual-ethernet">Virtual Ethernet</a> can be used to support processing of multiple, complex waveforms in parallel.</p> <p><strong>Analytics</strong> – <a href="https://www.neuroblade.com/">NeuroBlade</a>‘s SQL Processing Unit (SPU) integrates with Presto, Apache Spark, and other open source query engines, delivering faster query processing and market-leading query throughput efficiency when run on F2 instances.</p> <p><span style="text-decoration: underline;"><strong>Things to Know</strong></span><br> Here are a couple of final things that you should know about the F2 instances:</p> <p><strong>Regions</strong> – F2 instances are available today in the US East (N. Virginia) and Europe (London) AWS Regions, with plans to extend availability to additional regions over time.</p> <p><strong>Operating Systems</strong> – F2 instances are Linux-only.</p> <p><strong>Purchasing Options</strong> – F2 instances are available in <a href="https://aws.amazon.com/ec2/pricing/on-demand/">On-Demand</a>, <a href="https://aws.amazon.com/ec2/spot/">Spot</a>,&nbsp;<a href="https://aws.amazon.com/savingsplans/compute-pricing/">Savings Plan</a>, <a href="https://aws.amazon.com/ec2/pricing/dedicated-instances/">Dedicated Instance</a>, and <a href="https://aws.amazon.com/ec2/dedicated-hosts/">Dedicated Host</a> form.</p> <p></p> <p>— <a href="https://twitter.com/jeffbarr">Jeff</a>;</p> <p></p> <p><em><strong>Updated on Feb 5, 2025</strong> – We added <a href="https://aws.amazon.com/about-aws/whats-new/2025/02/amazon-ec2-f2-6xlarge-new-f2-instance-size/">F2.6xlarge, a new smaller size of EC2 F2 instances</a> for applications that are more cost-efficient or performant when running on a single FPGA.</em></p> Introducing Buy with AWS: an accelerated procurement experience on AWS Partner sites, powered by AWS Marketplace https://aws.amazon.com/blogs/aws/introducing-buy-with-aws-an-accelerated-procurement-experience-on-aws-partner-sites-powered-by-aws-marketplace/ <![CDATA[Prasad Rao]]> Wed, 04 Dec 2024 23:30:08 +0000 <![CDATA[Announcements]]> <![CDATA[AWS Marketplace]]> <![CDATA[AWS re:Invent]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> a4c71b19d5eb758bbfd45a28141c249bef867d25 Buy with AWS enables you to seamlessly discover and purchase products available in AWS Marketplace from AWS Partner websites using your AWS account. <p>Today, we are announcing <a href="https://aws.amazon.com/marketplace/features/buy-with-aws">Buy with AWS</a>, a new way to discover and purchase solutions available in <a href="https://aws.amazon.com/mp/marketplace-service/overview/">AWS Marketplace</a> from <a href="https://aws.amazon.com/partners/">AWS Partner</a> sites. You can use Buy with AWS to accelerate and streamline your product procurement process on websites outside of <a href="https://aws.amazon.com/">Amazon Web Services (AWS)</a>. This feature provides you the ability to find, try, and buy solutions from Partner websites using your AWS account</p> <p>AWS Marketplace is a curated digital store for you to find, buy, deploy, and manage cloud solutions from Partners. Buy with AWS is another step towards AWS Marketplace making it easy for you to find and procure the right Partner solutions, when and where you need them. You can conveniently find and procure solutions in AWS Marketplace, through integrated AWS service consoles, and now on Partner websites.</p> <p><span style="text-decoration: underline;"><strong>Accelerate cloud solution discovery and evaluation</strong></span></p> <p>You can now discover solutions from Partners available for purchase through AWS Marketplace as you explore solutions on the web beyond AWS.</p> <p>Look for products that are “Available in AWS Marketplace” when browsing on Partner sites, then accelerate your evaluation process with fast access to free trials, demo requests, and inquiries for custom pricing.</p> <p>For example, I want to evaluate <a href="https://www.wiz.io/">Wiz</a> to see how it can help with my cloud security requirements. While browsing the Wiz website, I come across a <a href="https://www.wiz.io/partners/aws">page where I see “Connect Wiz with Amazon Web Services (AWS)”</a>.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/Wiz-1-2.png"><img loading="lazy" class="aligncenter wp-image-91568 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/Wiz-1-2.png" alt="Wiz webpage featuring Buy With AWS" width="1307" height="785"></a></p> <p>I choose <strong>Try with AWS</strong>. It asks me to sign in to my AWS account if I’m not signed in already. I’m then presented with a Wiz and AWS co-branded page for me to sign up for the free trial.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/Wiz-2.png"><img loading="lazy" class="aligncenter wp-image-91556 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/Wiz-2.png" alt="Wiz and AWS co-branded page to sign up for free trial using Buy with AWS through AWS Marketplace" width="904" height="458"></a></p> <p>The discovery experience that you see will vary depending on type of the Partner website you’re shopping from. Wiz is an example of how Buy with AWS can be implemented by an independent software vendor (ISV). Now, let’s look at an example of an AWS Marketplace Channel Partner, or reseller, who operates a storefront of their own.</p> <p>I browse to the <a href="https://marketplace-aws.bytes.co.uk/products">Bytes storefront</a> with product listings from AWS Marketplace. I have the option to filter and search from the curated product listings, which are available in AWS Marketplace, on the Bytes site.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/Bytes-1.png"><img loading="lazy" class="aligncenter wp-image-91558 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/Bytes-1.png" alt="Bytes storefront with product listings from AWS Marketplace" width="904" height="634"></a></p> <p>I choose <strong>View Details</strong> for Fortinet and see an option to <strong>Request Private Offer</strong> from AWS.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/Bytes-2.png"><img loading="lazy" class="aligncenter wp-image-91559 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/Bytes-2.png" alt="Bytes storefront with option to Request Private Offer for Fortinet from AWS Marketplace" width="904" height="404"></a></p> <p>As you can tell, on a Channel Partner site, you can browse curated product listings available in AWS Marketplace, filter products, and request custom pricing directly from their website.</p> <p><span style="text-decoration: underline;"><strong>Streamline product procurement on AWS Partner sites</strong></span><br> I had a seamless experience using Buy with AWS to access a free trial for Wiz and browse through the Bytes storefront to request a private offer.</p> <p>Now I want to try <a href="https://www.databricks.com/">Databricks</a> for one of the applications I’m building. I sign up for a <a href="http://signup.databricks.com/">Databricks trial</a> through their website.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/DB-1.png"><img loading="lazy" class="aligncenter wp-image-91560 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/DB-1.png" alt="Database homepage after login with option to Upgrade" width="1443" height="500"></a></p> <p>I chose <strong>Upgrade</strong> and see Databricks is available in AWS Marketplace, which gives me the option to <strong>Buy with AWS</strong>.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/DB-2.png"><img loading="lazy" class="aligncenter wp-image-91561 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/DB-2.png" alt="Option to upgrade to Databricks premium using Buy with AWS feature of AWS marketplace" width="1426" height="882"></a></p> <p>I choose <strong>Buy with AWS</strong>, and after I sign in to my AWS account, I land on a Databricks and AWS Marketplace co-branded procurement page.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/DB-3.png"><img loading="lazy" class="aligncenter wp-image-91562 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/DB-3.png" alt="Databricks and AWS co-branded page to subscribe using Buy with AWS" width="1433" height="888"></a></p> <p>I complete the purchase on the co-branded procurement page and continue to set up my Databricks account.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/DB-4.png"><img loading="lazy" class="aligncenter wp-image-91563 size-full" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/DB-4.png" alt="Databricks and AWS co-branded page after subscribing using Buy with AWS" width="1431" height="892"></a></p> <p>As you can tell, I didn’t have to navigate the challenge of managing procurement processes for multiple vendors. I also didn’t have to speak with a sales representative or onboard a new vendor in my billing system, which would have required multiple approvals and delayed the overall process.</p> <p><span style="text-decoration: underline;"><strong>Access centralized billing and benefits through AWS Marketplace</strong></span><br> Because Buy with AWS purchases are transacted through and managed in AWS Marketplace, you also benefit from the post-purchase experience of AWS Marketplace, including consolidated AWS billing, centralized subscription management, and access to cost optimization tools.</p> <p>For example, through the <a href="https://aws.amazon.com/aws-cost-management/aws-billing/">AWS Billing and Cost Management console</a>, I can centrally manage all my AWS purchases, including Buy with AWS purchases, from one dashboard. I can easily access and process invoices for all of my organization’s AWS purchases. I also need to have valid <a href="https://docs.aws.amazon.com/marketplace/latest/buyerguide/buyer-iam-users-groups-policies.html">AWS Identity and Access Management (IAM) permissions</a> to manage subscriptions and make a purchase through AWS Marketplace.</p> <p><a href="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/billing-1-1.png"><img loading="lazy" class="aligncenter size-full wp-image-91571" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/24/billing-1-1.png" alt="" width="1453" height="703"></a></p> <p>AWS Marketplace not only simplifies my billing but also helps in maintaining governance over spending by helping me manage purchasing authority and subscription access for my organization with centralized visibility and controls. I can manage my budget with pricing flexibility, cost transparency, and AWS cost management tools.</p> <p><span style="text-decoration: underline;"><strong>Buy with AWS for Partners</strong></span><br> Buy with AWS enables Partners who sell or resell products in AWS Marketplace to create new solution discovery and buying experiences for customers on their own websites. By adding call to action (CTA) buttons to their websites such as “Buy with AWS”, “Try free with AWS”, “Request private offer”, and “Request demo”, Partners can help accelerate product evaluation and the path-to-purchase for customers.</p> <p>By integrating with <a href="https://docs.aws.amazon.com/marketplace/latest/APIReference/welcome.html">AWS Marketplace APIs</a>, Partners can display products from the AWS Marketplace catalog, allow customers to sort and filter products, and streamline private offers. Partners implementing Buy with AWS can access AWS Marketplace creative and messaging resources for guidance on building their own web experiences. Partners who implement Buy with AWS can access metrics for insights into engagement and conversion performance.</p> <p>The&nbsp;<a href="https://aws.amazon.com/marketplace/management/homepage?pageType=awsmpmp%3Acustomer">Buy with AWS onboarding guide in the AWS Marketplace Management Portal</a> details how Partners can get started.</p> <p><span style="text-decoration: underline;"><strong>Learn more</strong></span><br> Visit the <a href="https://aws.amazon.com/marketplace/features/buy-with-aws">Buy with AWS page</a> to learn more and explore Partner sites that offer Buy with AWS.</p> <p>To learn more about selling or reselling products using Buy with AWS on your website, visit:</p> <ul> <li><a href="https://aws.amazon.com/partners/marketplace/buy-with-aws/">Buy with AWS seller page</a></li> <li><a href="https://aws.amazon.com/marketplace/management/homepage?pageType=awsmpmp%3Acustomer">Buy with AWS onboarding guide in the AWS Marketplace Management Portal</a></li> </ul> <p>– <a href="https://www.linkedin.com/in/kprasadrao/">Prasad</a></p> Accelerate foundation model training and fine-tuning with new Amazon SageMaker HyperPod recipes https://aws.amazon.com/blogs/aws/accelerate-foundation-model-training-and-fine-tuning-with-new-amazon-sagemaker-hyperpod-recipes/ <![CDATA[Channy Yun (윤석찬)]]> Wed, 04 Dec 2024 18:21:16 +0000 <![CDATA[Amazon SageMaker HyperPod]]> <![CDATA[Announcements]]> <![CDATA[AWS re:Invent]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> 5f4d931d4077b46731468b69717f5ead7e44dfab Amazon SageMaker HyperPod recipes help customers get started with training and fine-tuning popular publicly available foundation models, like Llama 3.1 405B, in just minutes with state-of-the-art performance. <p>Today, we’re announcing the general availability of <a href="https://github.com/aws/sagemaker-hyperpod-recipes">Amazon SageMaker HyperPod recipes</a> to help data scientists and developers of all skill sets to get started training and fine-tuning <a href="https://aws.amazon.com/what-is/foundation-models/">foundation models</a> (FMs) in minutes with state-of-the-art performance. They can now access optimized recipes for training and fine-tuning popular publicly available FMs such as <a href="https://github.com/aws/sagemaker-hyperpod-recipes/blob/main/recipes_collection/recipes/fine-tuning/llama/hf_llama3_405b_seq128k_gpu_qlora.yaml">Llama 3.1 405B</a>, <a href="https://github.com/aws/sagemaker-hyperpod-recipes/blob/main/recipes_collection/recipes/training/llama/hf_llama3_2_90b_seq8k_gpu_p5x32_pretrain.yaml">Llama 3.2 90B</a>, or <a href="https://github.com/aws/sagemaker-hyperpod-recipes/blob/main/recipes_collection/recipes/training/mixtral/hf_mixtral_8x22b_seq8k_gpu_p5x32_pretrain.yaml">Mixtral 8x22B</a>.</p> <p>At AWS re:Invent 2023, we <a href="https://aws.amazon.com/blogs/aws/introducing-amazon-sagemaker-hyperpod-a-purpose-built-infrastructure-for-distributed-training-at-scale/">introduced SageMaker HyperPod</a> to reduce time to train FMs by up to 40 percent and scale across more than a thousand compute resources in parallel with preconfigured distributed training libraries. With SageMaker HyperPod, you can find the required accelerated compute resources for training, create the most optimal training plans, and run training workloads across different blocks of capacity based on the availability of compute resources.</p> <p>SageMaker HyperPod recipes include a training stack tested by AWS, removing tedious work experimenting with different model configurations, eliminating weeks of iterative evaluation and testing. The recipes automate several critical steps, such as loading training datasets, applying distributed training techniques, automating checkpoints for faster recovery from faults, and managing the end-to-end training loop.</p> <p>With a simple recipe change, you can seamlessly switch between GPU- or Trainium-based instances to further optimize training performance and reduce costs. You can easily run workloads in production on SageMaker HyperPod or SageMaker training jobs.</p> <p><u><strong>SageMaker HyperPod recipes in action</strong><br> </u>To get started, visit the <a href="https://github.com/aws/sagemaker-hyperpod-recipes">SageMaker HyperPod recipes GitHub repository</a> to browse training recipes for popular publicly available FMs.</p> <p><img loading="lazy" class="aligncenter wp-image-92923 size-full" style="width: 90%; border: solid 1px #ccc;" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/12/03/2024-sagemaker-hyperpod-recipes-github-1.png" alt="" width="1206" height="1332"></p> <p>You only need to edit straightforward recipe parameters to specify an instance type and the location of your dataset in cluster configuration, then run the recipe with a single line command to achieve state-of-art performance.</p> <p>You need to edit the recipe config.yaml file to specify the model and cluster type after cloning the repository.</p> <pre><code class="lang-bash">$ git clone --recursive https://github.com/aws/sagemaker-hyperpod-recipes.git $ cd sagemaker-hyperpod-recipes $ pip3 install -r requirements.txt. $ cd ./recipes_collections $ vim config.yaml</code></pre> <p>The recipes support <a href="https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-slurm.html">SageMaker HyperPod with Slurm</a>, <a href="https://aws.amazon.com/blogs/aws/amazon-sagemaker-hyperpod-introduces-amazon-eks-support/">SageMaker HyperPod with Amazon Elastic Kubernetes Service (Amazon EKS)</a>, and <a href="https://docs.aws.amazon.com/sagemaker/latest/dg/how-it-works-training.html">SageMaker training jobs</a>. For example, you can set up a cluster type (Slurm orchestrator), a model name (Meta Llama 3.1 405B language model), an instance type (<code>ml.p5.48xlarge</code>), and your data locations, such as storing the training data, results, logs, and so on.</p> <pre><code class="lang-yaml">defaults: - <strong>cluster: slurm</strong> # support: slurm / k8s / sm_jobs - <strong>recipes: fine-tuning/llama/hf_llama3_405b_seq8k_gpu_qlora</strong> # name of model to be trained debug: False # set to True to debug the launcher configuration <strong>instance_type: ml.p5.48xlarge</strong> # or other supported cluster instances base_results_dir: # Location(s) to store the results, checkpoints, logs etc.</code></pre> <p>You can optionally adjust model-specific training parameters in this YAML file, which outlines the optimal configuration, including the number of accelerator devices, instance type, training precision, parallelization and sharding techniques, the optimizer, and logging to monitor experiments through <a href="https://www.tensorflow.org/tensorboard">TensorBoard</a>.</p> <pre><code class="lang-yaml">run: name: llama-405b results_dir: ${base_results_dir}/${.name} time_limit: "6-00:00:00" restore_from_path: null trainer: devices: 8 num_nodes: 2 accelerator: gpu precision: bf16 max_steps: 50 log_every_n_steps: 10 ... exp_manager: exp_dir: # location for TensorBoard logging name: helloworld create_tensorboard_logger: True create_checkpoint_callback: True checkpoint_callback_params: ... auto_checkpoint: True # for automated checkpointing use_smp: True distributed_backend: smddp # optimized collectives # Start training from pretrained model model: model_type: llama_v3 train_batch_size: 4 tensor_model_parallel_degree: 1 expert_model_parallel_degree: 1 # other model-specific params</code></pre> <p>To run this recipe in SageMaker HyperPod with Slurm, you must prepare the SageMaker HyperPod cluster following the <a href="https://catalog.workshops.aws/sagemaker-hyperpod/en-US/01-cluster">cluster setup instruction</a>.</p> <p>Then, connect to the SageMaker HyperPod head node, access the Slurm controller, and copy the edited recipe. Next, you run a helper file to generate a Slurm submission script for the job that you can use for a dry run to inspect the content before starting the training job.</p> <pre><code class="lang-bash">$ python3 main.py --config-path recipes_collection --config-name=config</code></pre> <p>After training completion, the trained model is automatically saved to your assigned data location.</p> <p>To run this recipe on SageMaker HyperPod with Amazon EKS, clone the recipe from the GitHub repository, install the requirements, and edit the recipe (<code>cluster: k8s</code>) on your laptop. Then, create a link between your laptop and running the EKS cluster and subsequently use the <a href="https://docs.aws.amazon.com/sagemaker/latest/dg/smcluster-getting-started-cli.html">HyperPod Command Line Interface (CLI)</a> to run the recipe.</p> <pre><code class="lang-bash">$ hyperpod start-job –recipe fine-tuning/llama/hf_llama3_405b_seq8k_gpu_qlora \ --persistent-volume-claims fsx-claim:data \ --override-parameters \ '{ "recipes.run.name": "hf-llama3-405b-seq8k-gpu-qlora", "recipes.exp_manager.exp_dir": "/data/&lt;your_exp_dir&gt;", "cluster": "k8s", "cluster_type": "k8s", "container": "658645717510.dkr.ecr.&lt;region&gt;.amazonaws.com/smdistributed-modelparallel:2.4.1-gpu-py311-cu121", "recipes.model.data.train_dir": "&lt;your_train_data_dir&gt;", "recipes.model.data.val_dir": "&lt;your_val_data_dir&gt;", }'</code></pre> <p>You can also run recipe on SageMaker training jobs using <a href="https://sagemaker.readthedocs.io/en/stable/">SageMaker Python SDK</a>. The following example is running PyTorch training scripts on SageMaker training jobs with overriding training recipes.</p> <pre><code class="lang-python">... recipe_overrides = { "run": { "results_dir": "/opt/ml/model", }, "exp_manager": { "exp_dir": "", "explicit_log_dir": "/opt/ml/output/tensorboard", "checkpoint_dir": "/opt/ml/checkpoints", }, "model": { "data": { "train_dir": "/opt/ml/input/data/train", "val_dir": "/opt/ml/input/data/val", }, }, } pytorch_estimator = PyTorch( output_path=&lt;output_path&gt;, base_job_name=f"llama-recipe", role=&lt;role&gt;, instance_type="p5.48xlarge", training_recipe="fine-tuning/llama/hf_llama3_405b_seq8k_gpu_qlora", recipe_overrides=recipe_overrides, sagemaker_session=sagemaker_session, tensorboard_output_config=tensorboard_output_config, ) ...</code></pre> <p>As training progresses, the model checkpoints are stored on <a href="https://aws.amazon.com/s3">Amazon Simple Storage Service (Amazon S3)</a> with the fully automated checkpointing capability, enabling faster recovery from training faults and instance restarts.</p> <p><strong><u>Now available</u></strong><br> Amazon SageMaker HyperPod recipes are now available in the <a href="https://github.com/aws/sagemaker-hyperpod-recipes">SageMaker HyperPod recipes GitHub repository</a>. To learn more, visit the <a href="https://aws.amazon.com/sagemaker-ai/hyperpod/">SageMaker HyperPod product page</a> and the <a href="https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod.html">Amazon SageMaker AI Developer Guide</a>.</p> <p>Give SageMaker HyperPod recipes a try and send feedback to <a href="https://repost.aws/tags/TAT80swPyVRPKPcA0rsJYPuA/amazon-sagemaker">AWS re:Post for SageMaker</a> or through your usual AWS Support contacts.</p> <p>— <a href="https://twitter.com/channyun">Channy</a></p> AWS Education Equity Initiative: Applying generative AI to educate the next wave of innovators https://aws.amazon.com/blogs/aws/aws-education-equity-initiative-applying-generative-ai-to-educate-the-next-wave-of-innovators/ <![CDATA[Jeff Barr]]> Wed, 04 Dec 2024 18:13:13 +0000 <![CDATA[Announcements]]> <![CDATA[AWS re:Invent]]> <![CDATA[Education]]> <![CDATA[Featured]]> <![CDATA[Launch]]> <![CDATA[News]]> 895b231f474517397ead998b88bfac9286617a23 Amazon commits $100M to empower education equity initiatives, enabling socially-minded organizations to create AI-powered digital learning solutions. This aims to reach underserved students globally through innovative platforms, apps, and assistants. <p>Building on the work that we and our partners have been doing for many years, Amazon is committing up to $100 million in cloud technology and technical resources to help existing, dedicated learning organizations reach more learners by creating new and innovative digital learning solutions, all as part of the <a href="https://aws.amazon.com/about-aws/our-impact/education-equity-initiative/">AWS Education Equity Initiative</a>.</p> <p><span style="text-decoration: underline;"><strong>The Work So Far</strong></span><br> AWS and Amazon have a long-standing commitment to learning and education. Here’s a sampling of what we have already done:</p> <p><a href="https://aws.amazon.com/machine-learning/scholarship/"><strong>AWS AI &amp; ML Scholarship Program</strong></a> – This program has awarded $28 million in scholarships to approximately 6000 students.</p> <p><a href="https://aws.amazon.com/ai/machine-learning/educators/"><strong>Machine Learning University</strong></a> – MLU offers a free program helping community colleges and Historically Black Colleges and Universities (HBCUs) teach data management, artificial intelligence, and machine learning concepts. The program is designed to address opportunity gaps by supporting students who are historically underserved and underrepresented in technology disciplines.</p> <p><a href="https://www.amazonfutureengineer.com/"><strong>Amazon Future Engineer</strong></a> – Since 2021, up to $46 million in scholarships has been awarded to 1150 students through this program. In the past year, more than 2.1 million students received over 17 million hours of STEM education, literacy, and career exploration courses through this and other Amazon philanthropic education programs in the United States. I was able to speak to one such session last year and it was an amazing experience:</p> <p><img loading="lazy" class="aligncenter size-full wp-image-91813" src="https://d2908q01vomqb2.cloudfront.net/da4b9237bacccdf19c0760cab7aec4a8359010b0/2024/11/26/afe_jeff_2024_1.png" alt="" width="892" height="670"></p> <p><a href="https://www.aboutamazon.com/news/workplace/amazon-to-help-29-million-people-around-the-world-grow-their-tech-skills-with-free-cloud-computing-skills-training-by-2025"><strong>Free Cloud Training</strong></a> – In late 2020 we set a goal of helping 29 million people grow their tech skills with free cloud computing training by 2025. We worked hard and met that target a year ahead of time!</p> <p><span style="text-decoration: underline;"><strong>There’s More To Do</strong></span><br> Despite all of this work and progress, there’s still more to be done. The future is definitely not evenly distributed: over half a billion students cannot be reached by digital learning today.</p> <p>We believe that Generative AI can amplify the good work that socially-minded edtech organizations, non-profits, and governments are already doing. Our goal is to empower them to build new and innovative digital learning systems that can amplify their work and allow them to reach a bigger audience.</p> <p>With the launch of the AWS Education Equity Initiative, we want to help pave the way for the next generation of technology pioneers as they build powerful tools, train foundation models at scale, and create AI-powered teaching assistants.</p> <p>We are committing up to $100 million in cloud technology and comprehensive technical advising over the next five years. The awardees will have access to the portfolio of AWS services and technical expertise so that they can build and scale learning management systems, mobile apps, chatbots, and other digital learning tools. As part of the application process, applicants will be asked to demonstrate how their proposed solution will benefit students from underserved and underrepresented communities.</p> <p>As I mentioned earlier, our partners are already doing a lot of great work in this area. For example:</p> <p><a href="https://code.org/"><strong> Code.org</strong></a> has already used AWS to scale their free computer science curriculum to millions of students in more than 100 countries. With this initiative, they will expand their use of <a href="https://aws.amazon.com/bedrock/">Amazon Bedrock</a> to provide an automated assessment of student projects, freeing up educator time that can be use for individual instruction and tailored learning.</p> <p><a href="https://rocketlearning.org/"><strong>Rocket Learning</strong></a> focuses on early childhood education in India. They will use Amazon Q in QuickSight to enhance learning outcomes for more than three million children.</p> <p>I’m super excited about this initiative and look forward to seeing how it will help to create and educate the next generation of technology pioneers!</p> <p></p> <p>— <a href="https://twitter.com/jeffbarr">Jeff</a>;</p> <p></p>