Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Include test suite results for validator implementations #125

Closed
awwright opened this issue May 2, 2016 · 6 comments
Closed

Include test suite results for validator implementations #125

awwright opened this issue May 2, 2016 · 6 comments

Comments

@awwright
Copy link
Member

awwright commented May 2, 2016 •
edited
Loading

It might be useful if we include a brief summary of what features different validators support, and indicate test suite compliance.

This might be a task better handled by someone else, though.
@Relequestual
Copy link
Member

Further specification needed.

@awwright
Copy link
Member Author

I'm not really sure what I was thinking, but lemme guess

@adamvoss
Copy link

Ideally, the test suite would produce a machine readable report (YAML, JSON, or CSV) which could be added within _data and then displayed on the website in a similar manner as used in json-schema-org/json-schema-org.github.io#131.

Perhaps too high of barrier to entry, but this could even be automated in separate repository where all implementations to be listed had to include code that boot-strapped testing their library against the suite and generating the report.

@Relequestual
Copy link
Member

Looking at shields.io, jenkins is the only one to support number of tests passed.
We could say we only display build status for projects which use at least the official test suite.

@adamvoss adamvoss mentioned this issue Sep 22, 2017
Closed
This was referenced Sep 25, 2017
Closed
Closed
Julian referenced this issue in json-schema-org/JSON-Schema-Test-Suite Sep 4, 2019
@Julian
Make ajv's tests not fail the build.
0f888a8 
This will shortly move to a separate job entirely, since
right now only ajv's tests are running here, and they should
not be.

But we'll likely add a way for implementations to opt-in
to having their tests run during new test additions as part
of json-schema-org/json-schema-org.github.io#6, but not fail
the build when their own tests fail.
@benjagm benjagm transferred this issue from json-schema-org/json-schema-org.github.io Oct 11, 2023
@gregsdennis
Copy link
Member

I think Bowtie properly covers this. It doesn't yet have all of the implementations, but the framework is there.

@benjagm
Copy link
Collaborator

benjagm commented Nov 23, 2023

We'll have this covered in the new version of the implenmeters page #160

Closed in favour of #160

@benjagm benjagm closed this as not planned Won't fix, can't repro, duplicate, stale Nov 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@awwright @Relequestual @adamvoss @gregsdennis @benjagm