The Graviton2 uses more recent technology. The result is different.
One year ago, I published an article on Amazon.com (AMZN) titled "Amazon.com's Graviton CPU: A New War, A Lost Battle." In that article, I detailed why Amazon.com's then-new Graviton CPU was not likely to be competitive. The main reason was that it was based on ARM's old A72 core. Here's my conclusion at the time:
This particular battle, this particular ARM implementation, will likely show itself to not be competitive against present day x86 instances.
However, the war has clearly started. It won't end anytime soon, and given what ARM and Apple are currently achieving this war will become a lot more difficult for Intel (NASDAQ:INTC) and AMD (NASDAQ:AMD) in the near future.
Amazon.com and cloud customers in general will eventually emerge winners, as processing power will become cheaper for all. Just not quite yet.
In that article I also predicted that things could turn much more different once Amazon used technology based on ARM's latest core (at the time), the A76.
Today, Amazon announced the successor to the original Graviton CPU, the Graviton2. The Graviton2 is based on ARM's Neoverse N1 technology, which is itself based on the A76 core I said would make things substantially different. In this article, we'll see how different, using a similar approach to the original article.
Unlike during its first attempt, this time Amazon will be deploying technology based on ARM's latest design. The jump is huge. We're talking about a 4 generation jump (A72 - A73 - A75 -A76). On top of this, ARM's core performance took a large jump from the A75 to the A76 as well.
So what did this all mean in terms of performance? Amazon is saying the following (interestingly, these are comparisons to the Intel Xeon Platinum 8175 processor, whereas in my original article I compared to the Intel Xeon Platinum 8180, which runs at the same base frequency):
All of these performance enhancements come together to give these new instances a significant performance benefit over the 5th generation (M5, C5, R5) of EC2 instances. Our initial benchmarks show the following per-vCPU performance improvements over the M5 instances:
Of course, you'll say that Intel and AMD won't sit still. But neither will ARM. The next ARM core (A77) already promises another large (20%) single-core jump. This exceeds what's to be expected by Intel or AMD in the short term.
Of note, I concentrate on single-core performance, because that's mostly what server instances sell. Instances sell that or a few up to many cores. ARM tends to excel on multi-core performance as well, but this isn't as obvious from smartphone benchmarks. This is so because of power and thermal constraints as well as the fact that only a single A76 core is clocked at 2.84Ghz in the example I gave. Neither of these constraints exist on a server chip.
While Amazon's first attempt at ARM-based chips seemed too weak, the second attempt - the Graviton2 - already seems fully competitive.
This is yet another shot across the x86 bow. This also is yet another move toward the commoditization of computing power, and might result in more bargaining power for Amazon when buying chips from Intel or AMD. Obviously, later on it's likely that other players also will use ARM's Neoverse N1 and subsequent designs.
The pressure from this trend will not abate, because the next ARM core will, again, show faster performance improvement than the competing x86 solutions.
Disclosure: I/we have no positions in any stocks mentioned, and no plans to initiate any positions within the next 72 hours. I wrote this article myself, and it expresses my own opinions. I am not receiving compensation for it (other than from Seeking Alpha). I have no business relationship with any company whose stock is mentioned in this article.