Introduction
Cardano smart-contract language ecosystem develops rapidly and offers many languages without a single and comprehensive performance comparison. The purpose of Cardano onchain language benchmark project is to implement the same suite of Cardano onchain validators in multiple languages compiled to UPLC, develop a language-agnostic test suite to test the equivalence of validators, and measure the performance of each language looking at script size and execution units.
Specifications of validators that are to be implemented in each language are available here.
Benchmark results, when available, will be published on this website.
Everything, including specifications and this website is open-source and available on GitHub.
Specifications
Comparison
While trying to implement all validators as closely to each other as possible there are some differences that impact measured script size and execution units.
- Plutarch while decoding Data-encoded types is checking for invariants such as hashes lengths, map key ordering etc. which leads to higher start up cost visible in NFT Marketplace validator.
- Opshin does expose option to compile without tracing so that is included in the final size. All implementations use traces in their source code but remaining allow to strip it with a compilation flag.
Versions
- plutus-tx: 1.40.0.0
- plutarch: 1.10.1
- aiken: v1.0.29-alpha+unknown
- opshin: 0.24.0
Script size (bytes)
Script sizes are compared by compiling each script to CBOR and taking its binary size in bytes. Validators are compiled without traces if language supports it (Opshin does not) and are not passed through any external UPLC optimizer.
| Language | lp-minting-policy.bin | nft-marketplace-validator.bin | nft-minting-policy.bin | pool-validator.bin |
|---|---|---|---|---|
| Plutarch | 336 | 313 | 415 | 1063 |
| Aiken | 559 | 621 | 560 | 1420 |
| PlutusTx | 1691 | 3039 | 2000 | 3019 |
| Opshin | 1412 | 2619 | 1962 | 4196 |
Execution Units
Execution units are abstract units of CEK machine. Despite being called CPU and Memory they DO NOT mean CPU cycles or allocated bytes, these are abstract, deterministic units of the virtual machine that executes UPLC.
LP Policy - mint one
| Language | CPU | Memory |
|---|---|---|
| Plutarch | 18262734 | 50394 |
| Aiken | 20940727 | 71222 |
| PlutusTx | 66588364 | 278572 |
| Opshin | 39169515 | 153098 |
LP Policy - mint two
| Language | CPU | Memory |
|---|---|---|
| Plutarch | 31822785 | 83081 |
| Aiken | 34254003 | 115249 |
| PlutusTx | 76849433 | 325184 |
| Opshin | 63319892 | 234077 |
Pool NFT Policy - mint
| Language | CPU | Memory |
|---|---|---|
| Plutarch | 15992668 | 41967 |
| Aiken | 18828380 | 57680 |
| PlutusTx | 66772968 | 281765 |
| Opshin | 40795575 | 174802 |
Pool Validator - swap A for B
| Language | CPU | Memory |
|---|---|---|
| Plutarch | 102778551 | 233241 |
| Aiken | 103843031 | 320998 |
| PlutusTx | 292784637 | 1353180 |
| Opshin | 252048642 | 935119 |
Pool Validator - swap B for A
| Language | CPU | Memory |
|---|---|---|
| Plutarch | 102778551 | 233241 |
| Aiken | 103843031 | 320998 |
| PlutusTx | 292784637 | 1353180 |
| Opshin | 252048642 | 935119 |
Pool Validator - deposit
| Language | CPU | Memory |
|---|---|---|
| Plutarch | 104183634 | 234501 |
| Aiken | 108022727 | 335146 |
| PlutusTx | 328245188 | 1517862 |
| Opshin | 257128376 | 940115 |
Pool Validator - withdraw
| Language | CPU | Memory |
|---|---|---|
| Plutarch | 103879252 | 233399 |
| Aiken | 108343109 | 336348 |
| PlutusTx | 328615023 | 1519364 |
| Opshin | 257672758 | 942717 |
NFT Marketplace - buy one
| Language | CPU | Memory |
|---|---|---|
| Plutarch | 12256664 | 28669 |
| Aiken | 18989136 | 48289 |
| PlutusTx | 127041829 | 557062 |
| Opshin | 45869696 | 192397 |
NFT Marketplace - cancel one
| Language | CPU | Memory |
|---|---|---|
| Plutarch | 5756954 | 17509 |
| Aiken | 12502116 | 41565 |
| PlutusTx | 80367926 | 345018 |
| Opshin | 31521405 | 142689 |