A simple project to test JSON libraries with Delphi and C++Builder.

This is a simple project and not a final product. I know that there are many points that could be better structured. The initial goal was to quickly deploy a single unit "FoMain" kind of project, spending time to include and test the most popular JSON libraries for Delphi. The Delphi version has a simple structure with TLib and TTest classes. Also, it is important to mention that the size of JSON objects used in tests here doesn't represent the most common cases of data manipulation in JSON. Finally, the analysis of the results is not intended to detract from any of the tested libraries and should not be seen as any kind of criticism of the authors of the libraries. Knowledge is freedom.

Note: in order of inclusion.

• Delphi VCL 32-bits project built with version 12.1 (Athens Community Edition).
• C++Builder VCL 32-bits project built with version 10.2 (Tokyo).
• Old 64-bits machine: AMD A12-9700P RADEON R7, 10 COMPUTE CORES 4C+6G - 2.50 GHz - 12 GB RAM.

There are three test types:

• Speed Run
  • Generate N items { ... "key_i":"value_i", ... }
  • Save to file
  • Clear
  • Load from file
  • Find M items
  • Clone/parse
• Validation
• Open File

For each library and test type the app was ran and closed. The results of Speed Run compute the average time of 5 repetitions. The Memory consuption is logged and will be part of some results.

This is a performance test with the following configuration (select Default in the Preset list).

• N = 50k items.
• M = 1k items (keep same random sequence for all tests).
• 5 repetitions.
• Memory collumn is the app memory consuption after the Genereate sub-test.
• It is expected that the Clone/Parse sub-test consumes twice as memory as the Generate or Load from file sub-test.
• See images as confirmation.

Notes:

• See Conclusions about the EasyJson and System.JSON.
• See Know issues about the incomplete test for JsonTools.

Notes:

• See Know issues about the incomplete test for JsonTools.

Here are some results just for the Generate sub-test increasing N using C++Builder project.

This validation test should be analyzed carefully. Some libraries have violations for some sort of self-management in reading JSON data.

• .\test\valid files extracted from MJPA/SimpleJSON
• These are not valid JSON files because first line has a text as description.

List of test files names and description

• fail01.json = \x is not a valid escape character
• fail02.json = Objects require colon between name/value1111111
• fail03.json = Objects do not have comma separators
• fail04.json = Arrays don't have colon separators
• fail05.json = Truth is not a valid boolean value
• fail06.json = Strings need double quotes, not single quotes
• fail07.json = Line break in a string value is not valid
• fail08.json = Escaped line break char is still not valid
• fail09.json = Unclosed array
• fail10.json = Numbers require exponent if 'e' is there
• fail11.json = Only 1 sign char can precede the value
• fail12.json = Commas cannot close objects
• fail13.json = Brackets must be matching
• fail14.json = Double quotes must be escaped
• fail15.json = Key string must be quoted
• fail16.json = Arrays must not have comma after last value
• fail17.json = Arrays must have values between commas
• fail18.json = Nothing but whitespace can follow the root value
• fail19.json = Each opening bracket must be closed
• fail20.json = Extra comma after object
• fail21.json = Numbers cannot have leading 0s
• fail22.json = Numbers can't be hex encoded
• fail23.json = Decimal numbers need a digit before the dot
• pass01.json = General large array testing valid values
• pass02.json = Heavily nested array
• pass03.json = Nested object
• pass04.json = Simple string value
• pass05.json = Unicode character string
• pass06.json = From https://json.org/example.html

This is a simple test to open files with any library included into this project. This test will be used in a future update with very large JSON files (+ 100 MiB in size).

1. All Speed Run tests with Delphi version are twice as fast as with C++Builder.

2. For JSON structures with less than 5000 objects, the choice of libraries can be screened not only based on performance. Standard/Compiler compatibility and ease of use should have priority in terms of choice criterion.

3. Neslib.Json is the fastest library tested until now, closely followed Grijjy.Bson.

4. LkJson has great performance and the lowest memory consumption among all tested libraries. Some changes are needed to use it with Delphi and C++Builder 10.2 in order to save and load UTF-8 encoded files. For some, an obstacle can be that their interfaces are more verbose for C++ usage. For example:

JsonP = dynamic_cast<TlkJSONObject*>(TlkJSON::ParseText(TlkJSON::GenerateText(Json)))

5. The Validation tests can demonstrate that even the most modern libraries can have occasional small violations against the standard.

6. For older versions of Delphi and C++Builder, the McJSON library can be a good choice in terms of compatibility, ease of use and good performance.

7. This project demonstrates some of the facilities and obstacles encountered by C++Builder developers in using libraries developed for Delphi.

8. EasyJson uses System.JSON internally, so it is expected to see similar results.

• TgoBsonDocument.LoadFromJsonFile() failed.
• SuperObject compiles but it is not working with C++Builder. Any help getting SuperObject working with C++Builder is appreciated.
• JsonTools had problems saving to file: it was truncated at object "key25412". So, Speed Run tests were ran without the Clear and Load from file steps.
• JsonTools gave an error Root node must be an array or object trying to load form a UTF-8 file with 50k items file from other sub-tests.
• chimera.json seems to completelly break Delphi 10.4's code completion (Code insight manager = LSP).

These libraries were tested:

• XSuperObject does not compile with C++Builder 10.2.
• dwsJSON does not compile with Delphi 10.1 Starter.

There were necessary modifications in order to compile and run some libraries with C++Builder.

• uLkJSON:
  • {$DEFINE USE_D2009}
  • TlkJSONstreamed.LoadFromStream();
  • TlkJSONstreamed.SaveToStream();
• SuperObject:
  • defined(VER290) or defined(VER300) or defined(VER310) or defined(VER320) or defined(VER330) or defined(VER340) or defined(VER350) or defined(VER360)
  • procedure FromInterface;