mirror of
https://github.com/nlohmann/json.git
synced 2026-11-04 11:49:22 +00:00
Niels Lohmann
8ac5ddf2a8
Suite, timeline endpoint, Appendix D and the scalar-run numbers now come from
develop b2674a4a2f with #5990-#5992, #5996-#6006 and #6008 merged. With #6008,
arrays of one element skip the scalar run, so nested arrays no longer pay for
it. The suite ran three rounds per version; the round of 3.12.0 and of 3.13.0
that differed from the other two was dropped, as the setup table says.
Signed-off-by: Niels Lohmann <mail@nlohmann.me>
9.7 KiB
9.7 KiB
| 1 | benchmark | unit | 3.12.0 | 3.13.0 | speedup |
|---|---|---|---|---|---|
| 2 | Accept/canada | ns | 1.26911e+07 | 2.31896e+06 | 5.473 |
| 3 | Accept/citm_catalog | ns | 6.38348e+06 | 907300 | 7.036 |
| 4 | Accept/floats | ns | 1.13021e+08 | 2.2302e+07 | 5.068 |
| 5 | Accept/jeopardy | ns | 2.18859e+08 | 5.74875e+07 | 3.807 |
| 6 | Accept/signed_ints | ns | 1.15082e+08 | 2.76628e+07 | 4.160 |
| 7 | Accept/small_signed_ints | ns | 5.58745e+07 | 1.76566e+07 | 3.165 |
| 8 | Accept/twitter | ns | 2.45895e+06 | 474623 | 5.181 |
| 9 | Accept/unsigned_ints | ns | 1.13737e+08 | 2.91215e+07 | 3.906 |
| 10 | BinaryToCbor/1024 | ns | 303.306 | 101.854 | 2.978 |
| 11 | BinaryToCbor/128 | ns | 247.228 | 115.274 | 2.145 |
| 12 | BinaryToCbor/16 | ns | 239.518 | 48.6796 | 4.920 |
| 13 | BinaryToCbor/16384 | ns | 949.458 | 408.254 | 2.326 |
| 14 | BinaryToCbor/2048 | ns | 320.309 | 119.299 | 2.685 |
| 15 | BinaryToCbor/256 | ns | 265.095 | 88.0809 | 3.010 |
| 16 | BinaryToCbor/32 | ns | 249.054 | 48.4924 | 5.136 |
| 17 | BinaryToCbor/32768 | ns | 1533.16 | 801.01 | 1.914 |
| 18 | BinaryToCbor/4096 | ns | 412.14 | 169.413 | 2.433 |
| 19 | BinaryToCbor/512 | ns | 289.358 | 97.2851 | 2.974 |
| 20 | BinaryToCbor/64 | ns | 249.278 | 83.8812 | 2.972 |
| 21 | BinaryToCbor/8 | ns | 242.904 | 48.4594 | 5.013 |
| 22 | BinaryToCbor/8192 | ns | 511.492 | 247.585 | 2.066 |
| 23 | Copy/canada | ns | 3.65404e+06 | 2.86994e+06 | 1.273 |
| 24 | Copy/citm_catalog | ns | 1.62077e+06 | 1.45859e+06 | 1.111 |
| 25 | Copy/twitter | ns | 799004 | 725731 | 1.101 |
| 26 | CopyAssign/canada | ns | 3.66694e+06 | 2.88365e+06 | 1.272 |
| 27 | CopyAssign/citm_catalog | ns | 1.65324e+06 | 1.49021e+06 | 1.109 |
| 28 | CopyAssign/twitter | ns | 807988 | 738979 | 1.093 |
| 29 | CopyOnly/canada | ns | 1.51887e+06 | 1.50295e+06 | 1.011 |
| 30 | CopyOnly/citm_catalog | ns | 743278 | 781882 | 0.951 |
| 31 | CopyOnly/twitter | ns | 400238 | 403229 | 0.993 |
| 32 | CopyRing/canada | ns | 3.68209e+06 | 2.88747e+06 | 1.275 |
| 33 | CopyRing/citm_catalog | ns | 1.68855e+06 | 1.51116e+06 | 1.117 |
| 34 | CopyRing/twitter | ns | 849612 | 769730 | 1.104 |
| 35 | DestroyOnly/canada | ns | 2.12854e+06 | 1.37108e+06 | 1.552 |
| 36 | DestroyOnly/citm_catalog | ns | 875707 | 674090 | 1.299 |
| 37 | DestroyOnly/twitter | ns | 401328 | 322604 | 1.244 |
| 38 | Diff/canada | ns | 3.81123e+07 | 3.68674e+06 | 10.338 |
| 39 | Diff/citm_catalog | ns | 6.77551e+06 | 1.06847e+06 | 6.341 |
| 40 | Diff/twitter | ns | 4.82656e+06 | 639150 | 7.552 |
| 41 | Dump/canada / - | ns | 6.6893e+06 | 2.28575e+06 | 2.927 |
| 42 | Dump/canada / 4 | ns | 8.91301e+06 | 3.0094e+06 | 2.962 |
| 43 | Dump/citm_catalog / - | ns | 1.38998e+06 | 291064 | 4.776 |
| 44 | Dump/citm_catalog / 4 | ns | 1.92209e+06 | 414843 | 4.633 |
| 45 | Dump/floats / - | ns | 6.31567e+07 | 2.35913e+07 | 2.677 |
| 46 | Dump/floats / 4 | ns | 7.1106e+07 | 2.44198e+07 | 2.912 |
| 47 | Dump/jeopardy / - | ns | 2.03467e+08 | 3.07362e+07 | 6.620 |
| 48 | Dump/jeopardy / 4 | ns | 2.18712e+08 | 3.4619e+07 | 6.318 |
| 49 | Dump/signed_ints / - | ns | 2.37468e+07 | 1.06034e+07 | 2.240 |
| 50 | Dump/signed_ints / 4 | ns | 3.1988e+07 | 1.12253e+07 | 2.850 |
| 51 | Dump/small_signed_ints / - | ns | 1.7782e+07 | 7.91902e+06 | 2.245 |
| 52 | Dump/small_signed_ints / 4 | ns | 2.4964e+07 | 8.76268e+06 | 2.849 |
| 53 | Dump/twitter / - | ns | 1.39069e+06 | 208747 | 6.662 |
| 54 | Dump/twitter / 4 | ns | 1.58219e+06 | 246027 | 6.431 |
| 55 | Dump/unsigned_ints / - | ns | 2.36168e+07 | 7.99718e+06 | 2.953 |
| 56 | Dump/unsigned_ints / 4 | ns | 3.19304e+07 | 8.41574e+06 | 3.794 |
| 57 | Equal/canada | ns | 454099 | 336428 | 1.350 |
| 58 | Equal/citm_catalog | ns | 265088 | 254849 | 1.040 |
| 59 | Equal/twitter | ns | 140412 | 127744 | 1.099 |
| 60 | Flatten/canada | ns | 2.8443e+07 | 1.1054e+07 | 2.573 |
| 61 | Flatten/citm_catalog | ns | 6.37309e+06 | 3.00071e+06 | 2.124 |
| 62 | Flatten/twitter | ns | 3.47895e+06 | 2.04063e+06 | 1.705 |
| 63 | FlattenOrdered/citm_catalog | ns | 2.51402e+08 | 1.38824e+06 | 181.094 |
| 64 | FlattenOrdered/twitter | ns | 4.89453e+07 | 860119 | 56.905 |
| 65 | FromBinaryBuffer/bjdata / canada | ns | 8.21979e+06 | 4.07412e+06 | 2.018 |
| 66 | FromBinaryBuffer/bjdata / twitter | ns | 3.11089e+06 | 957789 | 3.248 |
| 67 | FromBinaryBuffer/bjdata_optimized / canada | ns | 8.68489e+06 | 2.39853e+06 | 3.621 |
| 68 | FromBinaryBuffer/bjdata_optimized / twitter | ns | 3.11963e+06 | 952143 | 3.276 |
| 69 | FromBinaryBuffer/bson / canada | ns | 9.42574e+06 | 4.20336e+06 | 2.242 |
| 70 | FromBinaryBuffer/bson / citm_catalog | ns | 3.86254e+06 | 1.56165e+06 | 2.473 |
| 71 | FromBinaryBuffer/bson / twitter | ns | 3.0653e+06 | 923900 | 3.318 |
| 72 | FromBinaryBuffer/cbor / canada | ns | 8.3425e+06 | 2.06207e+06 | 4.046 |
| 73 | FromBinaryBuffer/cbor / citm_catalog | ns | 3.68456e+06 | 1.43886e+06 | 2.561 |
| 74 | FromBinaryBuffer/cbor / floats | ns | 2.89541e+07 | 5.43061e+06 | 5.332 |
| 75 | FromBinaryBuffer/cbor / jeopardy | ns | 3.5724e+08 | 1.12871e+08 | 3.165 |
| 76 | FromBinaryBuffer/cbor / signed_ints | ns | 3.56166e+07 | 9.68737e+06 | 3.677 |
| 77 | FromBinaryBuffer/cbor / twitter | ns | 3.03558e+06 | 953772 | 3.183 |
| 78 | FromBinaryBuffer/msgpack / canada | ns | 8.3272e+06 | 2.06449e+06 | 4.034 |
| 79 | FromBinaryBuffer/msgpack / citm_catalog | ns | 3.68401e+06 | 1.41095e+06 | 2.611 |
| 80 | FromBinaryBuffer/msgpack / jeopardy | ns | 3.54505e+08 | 1.09031e+08 | 3.251 |
| 81 | FromBinaryBuffer/msgpack / twitter | ns | 3.02687e+06 | 934627 | 3.239 |
| 82 | FromBinaryBuffer/ubjson / canada | ns | 8.23819e+06 | 4.08039e+06 | 2.019 |
| 83 | FromBinaryBuffer/ubjson / citm_catalog | ns | 3.81107e+06 | 1.72436e+06 | 2.210 |
| 84 | FromBinaryBuffer/ubjson / jeopardy | ns | 3.64419e+08 | 1.13389e+08 | 3.214 |
| 85 | FromBinaryBuffer/ubjson / twitter | ns | 3.1103e+06 | 957344 | 3.249 |
| 86 | FromBinaryBuffer/ubjson_optimized / canada | ns | 8.48001e+06 | 2.36934e+06 | 3.579 |
| 87 | FromBinaryBuffer/ubjson_optimized / twitter | ns | 3.10764e+06 | 952334 | 3.263 |
| 88 | FromBinaryFile/bjdata / twitter | ns | 1.03821e+07 | 1.90031e+06 | 5.463 |
| 89 | FromBinaryFile/bson / twitter | ns | 1.01272e+07 | 1.80218e+06 | 5.619 |
| 90 | FromBinaryFile/cbor / canada | ns | 1.41591e+07 | 4.41088e+06 | 3.210 |
| 91 | FromBinaryFile/cbor / twitter | ns | 9.81686e+06 | 1.53188e+06 | 6.408 |
| 92 | FromBinaryFile/ubjson / canada | ns | 1.36558e+07 | 6.313e+06 | 2.163 |
| 93 | FromBinaryFile/ubjson / twitter | ns | 1.03653e+07 | 1.90283e+06 | 5.447 |
| 94 | FromBinaryShape/containers / bjdata | ns | 1.41661e+07 | 7.16958e+06 | 1.976 |
| 95 | FromBinaryShape/containers / bson | ns | 1.69957e+07 | 7.73162e+06 | 2.198 |
| 96 | FromBinaryShape/containers / cbor | ns | 1.37448e+07 | 3.88944e+06 | 3.534 |
| 97 | FromBinaryShape/containers / msgpack | ns | 1.36707e+07 | 3.84073e+06 | 3.559 |
| 98 | FromBinaryShape/containers / ubjson | ns | 1.41846e+07 | 7.17314e+06 | 1.977 |
| 99 | FromBinaryShape/containers / ubjson_optimized | ns | 1.47508e+07 | 4.4236e+06 | 3.335 |
| 100 | FromBinaryShape/nested / bjdata | ns | 93440.7 | 37989.3 | 2.460 |
| 101 | FromBinaryShape/nested / bson | ns | 99835.8 | 42028.7 | 2.375 |
| 102 | FromBinaryShape/nested / cbor | ns | 92913.6 | 35141.4 | 2.644 |
| 103 | FromBinaryShape/nested / msgpack | ns | 90678.9 | 34607.5 | 2.620 |
| 104 | FromBinaryShape/nested / ubjson | ns | 93863.6 | 38056.3 | 2.466 |
| 105 | FromBinaryShape/scalars / bjdata | ns | 2.44312e+07 | 1.13593e+07 | 2.151 |
| 106 | FromBinaryShape/scalars / cbor | ns | 2.54479e+07 | 5.6307e+06 | 4.519 |
| 107 | FromBinaryShape/scalars / msgpack | ns | 2.42975e+07 | 5.5278e+06 | 4.396 |
| 108 | FromBinaryShape/scalars / ubjson | ns | 2.46773e+07 | 1.14308e+07 | 2.159 |
| 109 | FromCborChunkedString/10000 chunks | ns | 89835.8 | 81350.8 | 1.104 |
| 110 | FromMsgpack/canada | ns | 1.41497e+07 | 4.42303e+06 | 3.199 |
| 111 | FromMsgpack/citm_catalog | ns | 8.88096e+06 | 2.25194e+06 | 3.944 |
| 112 | FromMsgpack/floats | ns | 5.92552e+07 | 2.76614e+07 | 2.142 |
| 113 | FromMsgpack/jeopardy | ns | 1.13309e+09 | 1.82341e+08 | 6.214 |
| 114 | FromMsgpack/signed_ints | ns | 6.22313e+07 | 3.28285e+07 | 1.896 |
| 115 | FromMsgpack/small_signed_ints | ns | 6.26259e+07 | 3.37353e+07 | 1.856 |
| 116 | FromMsgpack/twitter | ns | 9.78102e+06 | 1.47267e+06 | 6.642 |
| 117 | FromMsgpack/unsigned_ints | ns | 5.55099e+07 | 2.76571e+07 | 2.007 |
| 118 | GetArray<std::array<int, 1000>> | ns | 2231.77 | 639.734 | 3.489 |
| 119 | GetArray<std::deque<int>> | ns | 8132.06 | 1161.87 | 6.999 |
| 120 | GetArray<std::set<int>> | ns | 58400.5 | 41782.2 | 1.398 |
| 121 | GetArray<std::vector<int>> | ns | 6658.53 | 666.403 | 9.992 |
| 122 | GetMap/citm_catalog | ns | 3.41376e+06 | 2.3993e+06 | 1.423 |
| 123 | GetVectorDouble/floats | ns | 6.68224e+06 | 642457 | 10.401 |
| 124 | GetVectorInt/signed_ints | ns | 8.0387e+06 | 3.34843e+06 | 2.401 |
| 125 | Iterate/canada | ns | 868241 | 320718 | 2.707 |
| 126 | Iterate/citm_catalog | ns | 298022 | 167702 | 1.777 |
| 127 | Iterate/twitter | ns | 87014.5 | 62127.2 | 1.401 |
| 128 | JsonPointerAt/citm_catalog | ns | 1.82891e+06 | 1.14298e+06 | 1.600 |
| 129 | JsonPointerAt/twitter | ns | 787985 | 594251 | 1.326 |
| 130 | JsonPointerContains/citm_catalog | ns | 2.71277e+06 | 1.23364e+06 | 2.199 |
| 131 | JsonPointerContains/twitter | ns | 1.29352e+06 | 608656 | 2.125 |
| 132 | JsonPointerParse/citm_catalog | ns | 5.67308e+06 | 2.17151e+06 | 2.613 |
| 133 | JsonPointerParse/twitter | ns | 2.41421e+06 | 1.00071e+06 | 2.413 |
| 134 | JsonPointerToString/citm_catalog | ns | 6.62468e+06 | 1.87578e+06 | 3.532 |
| 135 | JsonPointerToString/twitter | ns | 2.1792e+06 | 806356 | 2.703 |
| 136 | ParseFILE/canada | ns | 5.23333e+07 | 1.38865e+07 | 3.769 |
| 137 | ParseFILE/citm_catalog | ns | 3.4642e+07 | 7.34915e+06 | 4.714 |
| 138 | ParseFILE/twitter | ns | 1.35777e+07 | 3.3065e+06 | 4.106 |
| 139 | ParseFile/canada | ns | 1.74258e+07 | 6.136e+06 | 2.840 |
| 140 | ParseFile/citm_catalog | ns | 7.66744e+06 | 2.424e+06 | 3.163 |
| 141 | ParseFile/floats | ns | 1.275e+08 | 4.72331e+07 | 2.699 |
| 142 | ParseFile/jeopardy | ns | 3.27525e+08 | 1.54786e+08 | 2.116 |
| 143 | ParseFile/signed_ints | ns | 1.2488e+08 | 4.54429e+07 | 2.748 |
| 144 | ParseFile/small_signed_ints | ns | 6.29991e+07 | 3.26251e+07 | 1.931 |
| 145 | ParseFile/twitter | ns | 3.32202e+06 | 1.35873e+06 | 2.445 |
| 146 | ParseFile/unsigned_ints | ns | 1.20673e+08 | 4.65984e+07 | 2.590 |
| 147 | ParseIndented/canada / 4 | ns | 3.39369e+07 | 5.15262e+06 | 6.586 |
| 148 | ParseIndented/citm_catalog / 4 | ns | 7.23096e+06 | 1.78365e+06 | 4.054 |
| 149 | ParseIndented/jeopardy / 4 | ns | 3.35238e+08 | 1.31409e+08 | 2.551 |
| 150 | ParseIndented/twitter / 4 | ns | 3.59342e+06 | 1.1224e+06 | 3.202 |
| 151 | ParseStreamValues/ndjson | ns | 7.01242e+06 | 3.71441e+06 | 1.888 |
| 152 | ParseStreamValues/numbers | ns | 1.89341e+06 | 380502 | 4.976 |
| 153 | ParseString/canada | ns | 1.50855e+07 | 4.42155e+06 | 3.412 |
| 154 | ParseString/citm_catalog | ns | 7.3013e+06 | 1.77547e+06 | 4.112 |
| 155 | ParseString/floats | ns | 1.18738e+08 | 2.7604e+07 | 4.301 |
| 156 | ParseString/jeopardy | ns | 3.03339e+08 | 1.28463e+08 | 2.361 |
| 157 | ParseString/signed_ints | ns | 1.20073e+08 | 3.12419e+07 | 3.843 |
| 158 | ParseString/small_signed_ints | ns | 6.0595e+07 | 2.40917e+07 | 2.515 |
| 159 | ParseString/twitter | ns | 3.17558e+06 | 1.05133e+06 | 3.021 |
| 160 | ParseString/unsigned_ints | ns | 1.18614e+08 | 3.21863e+07 | 3.685 |
| 161 | ParseStringOrdered/canada | ns | 1.50775e+07 | 4.37102e+06 | 3.449 |
| 162 | ParseStringOrdered/citm_catalog | ns | 1.08507e+07 | 1.61676e+06 | 6.711 |
| 163 | ParseStringOrdered/jeopardy | ns | 3.60997e+08 | 1.09757e+08 | 3.289 |
| 164 | ParseStringOrdered/twitter | ns | 4.35833e+06 | 906250 | 4.809 |
| 165 | Patch/canada | ns | 9.97854e+06 | 3.36623e+06 | 2.964 |
| 166 | Patch/citm_catalog | ns | 2.52632e+06 | 1.61385e+06 | 1.565 |
| 167 | Patch/twitter | ns | 1.45777e+06 | 850736 | 1.714 |
| 168 | SaxParse/canada | ns | 1.27867e+07 | 3.22211e+06 | 3.968 |
| 169 | SaxParse/citm_catalog | ns | 6.40874e+06 | 983039 | 6.519 |
| 170 | SaxParse/twitter | ns | 2.47756e+06 | 477699 | 5.186 |
| 171 | ToCbor/canada | ns | 1.37097e+06 | 545183 | 2.515 |
| 172 | ToCbor/citm_catalog | ns | 1.02285e+06 | 256578 | 3.986 |
| 173 | ToCbor/floats | ns | 8.91388e+06 | 1.89274e+06 | 4.710 |
| 174 | ToCbor/jeopardy | ns | 7.19583e+07 | 2.13225e+07 | 3.375 |
| 175 | ToCbor/signed_ints | ns | 1.13095e+07 | 2.75682e+06 | 4.102 |
| 176 | ToCbor/small_signed_ints | ns | 1.0181e+07 | 2.39796e+06 | 4.246 |
| 177 | ToCbor/twitter | ns | 633945 | 141532 | 4.479 |
| 178 | ToCbor/unsigned_ints | ns | 7.99728e+06 | 2.79118e+06 | 2.865 |
| 179 | ToJsonStrings/copy | ns | 5.82015e+06 | 5.54332e+06 | 1.050 |
| 180 | ToJsonStrings/move | ns | 5.81645e+06 | 3.0241e+06 | 1.923 |
| 181 | Unflatten/canada | ns | 4.1091e+07 | 1.08224e+07 | 3.797 |
| 182 | Unflatten/citm_catalog | ns | 9.69933e+06 | 3.46205e+06 | 2.802 |
| 183 | Unflatten/twitter | ns | 4.51774e+06 | 2.10929e+06 | 2.142 |