Results comparing Amazon, Google, Microsoft cloud performance are now available


by

Dallas Reedy

Cockroach Labs , a software and computer company that develops a commercial database management system, has released the 2020 Cloud Report, a benchmark comparison of cloud performance. The latest report compares the performance of Microsoft Azure in addition to Amazon Web Services (AWS) and Google Cloud Platform (GCP) compared in the 2018 benchmark tests . There are also several types of machines to test.

GCP Comes Out Swinging Against AWS and Azure in 2020 Cloud Report | Cockroach Labs
https://www.cockroachlabs.com/blog/2020-cloud-report/

2020 Cloud Report | Cockroach Labs
https://www.cockroachlabs.com/guides/2020-cloud-report

Cockroach Labs has been running cloud benchmark tests since 2017. Cockroach Labs says that corporate clouds can adopt new hardware, and this can cause significant fluctuations in benchmark results, so it is important to conduct benchmark tests continuously and re-evaluate them regularly.

The 2017 test showed that the performance of AWS and GCP was almost the same, but the 2018 test showed that AWS exceeded the performance of GCP by 40%. And in 2019, there was a big change.

First, Cockroach DB's ' TPC-C ' (benchmark of online transaction processing) showed the following results. From the top, ' c5d.4xlarge ' with 16 vCPUs and 32GiB of AWS, ' Azure Standard_DS14_v2 ' with 16 vCPUs and 112GiB of Azure , ' c2-standard-16 ' with 16 vCPUs and 64GiB of Google memory. Amazon (yellow), Google (blue), and Microsoft (red) each have four benchmarks, but overall Amazon's machines are at the top.



This result represents the maximum

tpmC when the p90 latency is kept below 5 seconds. Focusing on the top three, AWS c5d.4xlarge was 288861, Azure Standard_DS14_v2 was 27796, and GCP c2-standard-16 was 277583.



The price per tpmC was also shown, as the best performance could be achieved but the value would decrease if the cost was increased by a factor of two or three. In addition, the price is a complex topic that varies depending on the service type, so it also considers on-demand pricing, continuous use discount, committed use discount, and initial cost.

Looking at the price per tpmC, Google is around 1 dollar (about 110 yen) or less. Microsoft's high performance Azure Standard_DS14_v2 is just over $ 1, but '

Azure Standard_GS4 ' is over $ 4 (about 440 yen). For Amazon, c5d.4xlarge is less than $ 1, but ' i3en.6xlarge ' and ' i3.4xlarge ' are more than $ 4. AWS is excellent in terms of performance alone, but GCP is also high performance when price is taken into account.



However, saying that Cockroach Labs is not the best position to provide this kind of comparison, it is recommended to consider various pricing options.

The details of the benchmark test results can be downloaded from the following.

GitHub-cockroachlabs / cloud-report-2020: Details about and from the Cloud Report done in Q3 2019
https://github.com/cockroachlabs/cloud-report-2020



・ Continued
Amazon, Google, and Microsoft propose in the performance comparison report of their own cloud, the comparison policy after 2021 will be revised-gigazine

in Web Service, Posted by darkhorse_log