benchmarks page to track compilation speed

[delasy]

Features needed:

1. test every latest commit in thelang-io/the that is not marked [skip ci]
2. pagination of tests
3. columns (date time, commit, commit message truncated max 60 chars)
4. size of generated executable of itself

Tests:

1. test compilation of itself (core)
2. test compilation of CLI
3. test compilation of hello world program
4. test compilation of empty program

[epompeii]

Hey @delasy, I've been working on a continuous benchmarking tool to help with this sort of thing, Bencher: https://github.com/bencherdev/bencher

It supports arbitrary kinds of metrics so it should be able to store and detect performance regressions in all of the use cases that you listed above.
I've also compiled a list of prior art, so if you want to see what some other programming languages have done to track their performance that may also be useful: https://bencher.dev/docs/reference/prior-art

[delasy]

@epompeii wow your solution looks awesome! Though I need one-page solution that can integrate with existing CI server I have. Also one of requirements is to support The programming language, which I don't think you have plans to support.
If anything of above changes please let me know, I will reconsider my decision!

[epompeii]

Thanks!

Can you explain the one page solution a bit more?

Bencher should be able to support The Programming Language as is. The benchmark output would just need to be in the expected JSON format: https://bencher.dev/docs/explanation/adapters