Tech
AWS re:Invent 2024
Amazon CEO Andy Jassy at AWS re:Invent 2024 (Noah Berger/Getty Images)
super mega ultra

Amazon’s AI plans: custom chips, an Anthropic “ultracluster,” and its own foundation model

While Amazon’s new models appear to be competitive in terms of features and performance, that isn’t the main thing that the company is touting — it’s the cost.

Jon Keegan

This week at Amazon’s AWS re:Invent conference in Las Vegas, the company fleshed out its plans to both serve and compete with the larger AI industry.

AWS is largely AI agnostic. Customers can use pretty much any of the major AI models on the cloud-computing platform, running on servers that use chips from Nvidia, AMD, Qualcomm, and others.

But Amazon has also been building and selling computing powered by its purpose-built AI chips, including its latest Trainium2 chip, which Amazon is now making widely available on AWS’s EC2 service. Amazon says these new Trainium2 instances are built for training and deploying jumbo-sized large language models with better price performance than its current offerings.

Amazon also deepened its partnership with AI startup Anthropic, announcing that it’s building an “ultracluster” of “hundreds of thousands” of Trainium2 servers to train Anthropic’s next-generation LLM. Amazon recently doubled its investment in Anthropic, bringing the total to $8 billion.

Probably the most significant announcement was Amazon’s late entry to the foundational AI-model club. Named “Amazon Nova,” the new LLM comes in four flavors: a text-only Micro and three multimodal models, Lite, Pro, and Premier. Amazon touted benchmark scores for the Nova models, which place it in the same class as OpenAI’s GPT-4o and Meta’s Llama 3. Amazon’s multimodal Nova models can ingest and generate images and videos, like many of the other top models out there today.

While Amazon’s new models appear to be competitive in terms of features and performance, that isn’t the main thing that the company is touting — it’s the models’ low, low cost.

Running Amazon models on Amazon servers, powered by Amazon chips, yields significant cost savings and low latency. Amazon says its Nova models are “at least 75% less expensive” than the best-performing models available on AWS today.

More Tech

See all Tech
tech

WSJ: OpenAI plans Q4 IPO in race to be the first AI startup to enter public markets

OpenAI was the first to the generative AI market with ChatGPT, and now it hopes to be the first of its AI startup cohort to pull off an initial public offering, according to a report from The Wall Street Journal. The $500 billion startup is in a race against its $350 billion competitor Anthropic to IPO, who has also been exploring one.

According to the report, OpenAI is in talks with banks to try for a fourth-quarter IPO this year, which has the potential to be one of the largest IPOs ever, in a year that is expected to see many record breaking tech companies make tap into public markets to raise massive new rounds of capital.

Ahead of a potential public listing, OpenAI is reportedly attempting to raise a massive round of private investment. The company is reportedly aiming to raise $100 billion, with Amazon potentially accounting for up to half that target. Other investors in talks with OpenAI over the private fundraising round include Nvidia, Microsoft, and SoftBank.

According to the report, OpenAI is in talks with banks to try for a fourth-quarter IPO this year, which has the potential to be one of the largest IPOs ever, in a year that is expected to see many record breaking tech companies make tap into public markets to raise massive new rounds of capital.

Ahead of a potential public listing, OpenAI is reportedly attempting to raise a massive round of private investment. The company is reportedly aiming to raise $100 billion, with Amazon potentially accounting for up to half that target. Other investors in talks with OpenAI over the private fundraising round include Nvidia, Microsoft, and SoftBank.

tech

SpaceX is actually considering a merger with Tesla or xAI: Report

Bloomberg reports that Elon Musk’s SpaceX is considering merging with Musk’s Tesla. Earlier today, Reuters had reported that SpaceX was thinking of potentially merging with xAI ahead of SpaceX’s IPO this year.

From Bloomberg:

The firm has discussed the feasibility of a tie-up between SpaceX and Tesla, an idea that some investors are pushing, the people said, asking not to be identified as the information isn’t public. Separately, they are also exploring a tie-up between SpaceX and xAI ahead of an IPO, some of the people said.

Musk’s companies already have numerous relationships between themselves, including most recently Tesla’s $2 billion investment in xAI. At Tesla’s shareholder meeting last year, shareholders voted to invest in the company but the board didn’t approve the measure due to significant abstentions.

In 2024, SpaceX incurred about $2.4 million in expenses under commercial, licensing, and support agreements with Tesla, and Tesla incurred about $800,000 in expenses for Musk’s use of SpaceX’s jet.

From Bloomberg:

The firm has discussed the feasibility of a tie-up between SpaceX and Tesla, an idea that some investors are pushing, the people said, asking not to be identified as the information isn’t public. Separately, they are also exploring a tie-up between SpaceX and xAI ahead of an IPO, some of the people said.

Musk’s companies already have numerous relationships between themselves, including most recently Tesla’s $2 billion investment in xAI. At Tesla’s shareholder meeting last year, shareholders voted to invest in the company but the board didn’t approve the measure due to significant abstentions.

In 2024, SpaceX incurred about $2.4 million in expenses under commercial, licensing, and support agreements with Tesla, and Tesla incurred about $800,000 in expenses for Musk’s use of SpaceX’s jet.

tech

WSJ: Amazon considering $50 billion investment in OpenAI

What a difference half a day makes. Earlier today, The Information reported that Amazon was considering investing roughly $10 billion to $20 billion in OpenAI as part of a $60 billion fundraising round alongside Nvidia and Microsoft. Now The Wall Street Journal is reporting the e-commerce giant could invest up to $50 billion in the ChatGPT maker as part of a larger, $100 billion funding round. The Financial Times also earlier reported today a $100 billion funding round but with smaller amounts from Nvidia, Microsoft, and Amazon.

tech

Elon Musk’s SpaceX reportedly in talks to merge with xAI

Tesla CEO Elon Musk is reportedly exploring a merger between SpaceX and his artificial intelligence startup, xAI, a move that would bundle rockets, satellites, the social media site X, and AI under one company ahead of SpaceX’s long-anticipated IPO.

According to Reuters reporting, the deal would swap xAI shares for SpaceX stock, potentially valuing the combined operation north of $1 trillion.

Reuters reports:

Two entities have been set up in Nevada to facilitate the transaction, the person said.

Reuters could not determine the value of the deal, its ‌primary rationale, or its potential timing.

Corporate filings in Nevada show that those entities were set up on January 21. One of them, a limited liability company, lists SpaceX ​and Bret Johnsen, the companys chief financial officer, as managing members, while the other lists Johnsen as the companys only officer, the filings show.

The combined companies could also set the narrative groundwork for putting data centers in space — an idea that Musk and a number of other tech billionaires have been floating lately but that may not get off the ground.

In its earnings filings yesterday, Tesla disclosed that it recently made a $2 billion investment in xAI. Last year, Musk’s xAI bought Musk’s X in an all-stock deal.

Reuters reports:

Two entities have been set up in Nevada to facilitate the transaction, the person said.

Reuters could not determine the value of the deal, its ‌primary rationale, or its potential timing.

Corporate filings in Nevada show that those entities were set up on January 21. One of them, a limited liability company, lists SpaceX ​and Bret Johnsen, the companys chief financial officer, as managing members, while the other lists Johnsen as the companys only officer, the filings show.

The combined companies could also set the narrative groundwork for putting data centers in space — an idea that Musk and a number of other tech billionaires have been floating lately but that may not get off the ground.

In its earnings filings yesterday, Tesla disclosed that it recently made a $2 billion investment in xAI. Last year, Musk’s xAI bought Musk’s X in an all-stock deal.

Latest Stories

Sherwood Media, LLC produces fresh and unique perspectives on topical financial news and is a fully owned subsidiary of Robinhood Markets, Inc., and any views expressed here do not necessarily reflect the views of any other Robinhood affiliate, including Robinhood Markets, Inc., Robinhood Financial LLC, Robinhood Securities, LLC, Robinhood Crypto, LLC, or Robinhood Money, LLC.