Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add WMAS Test Suite to Test262 Runners section in README #4335

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

louaybassbouss
Copy link

Integrates Test262 ECMAScript tests into the WMAS Test Suite, built on Web Platform Tests (WPT). Ensures Test262 results are compatible with the WPT format.

Integrates Test262 ECMAScript tests into the WMAS Test Suite, built on WPT. Ensures Test262 results are compatible with the WPT format.
@louaybassbouss louaybassbouss requested a review from a team as a code owner November 27, 2024 15:58
@Ms2ger
Copy link
Contributor

Ms2ger commented Nov 28, 2024

Can I have a pointer to something that explains how this runs test262 tests?

@louaybassbouss
Copy link
Author

hello @Ms2ger apologies for late reply I missed notification to this message. Here are some details to the steps how we integrate the Test262 ECMAScript tests and how you can test them:

  • Web Media API Test Suite: this is the main GitHub Repo of the CTA WAVE WMAS Test Suite. It integrates tests from different sources WPT (Mainly Web Media API Tests), Test262 and Khronos WebGL.
    • One goal is to run tests on embedded devices like TVs and Set-Top-Boxes and in a unified test suite optimised for these kind of devices with limited interaction and performance capabilities in an automatic way.
    • Another goal is to provide test results and test reports in a unified format compatible with the WPT Format.
    • How we integrate Tests from the various Test Suites is basically done via an import script, here is an example for WMAS2023 Version.
  • Lets focus on Test262 ECMAScript tests:
    • After we import the Test262 ECMAScript tests (see import script), we generate HTML wrapper for each single ECMAScript. Example: generated ECMAScript tests for WMAS2023 are available in this folder
    • You can deploy and run the WMAS Test Suite locally as documented in README. But you can use the online WMAS Test Suite for example for WMAS2023 you can use this link: https://webapitests2023.ctawave.org/_wave/index.html. This is designed to run on TV devices, but you can also run it in Desktop Browsers as well. Here are some instructions how to run it in Desktop Browser:
      1. Open: https://webapitests2023.ctawave.org/_wave/index.html (tab1)
      2. Click Configure Session. This will open a new Tab (tab2).

        You can also scan the QR code and configure the session from a mobile device. This is helpful if the Test running on a TV.

      3. In the new tab (tab2), deselect all the APIs by selecting none and only select ecmascript. Then click on Start Session.
      4. Now the tests will run in tab1 and you can monitor the progress of the session in tab2.
      5. You can download the test results in JSON Format at any time on the progress page. An HTML report will be generated when the test session is completed.

Let me know if you have additional questions.

@ptomato
Copy link
Contributor

ptomato commented Jan 31, 2025

I think what Ms2ger is asking is for the link to go somewhere that makes it clear (to someone not familiar with the CTA WAVE project) what it has to do with test262. So, for example, the link could go to https://github.com/cta-wave/WMAS/tree/wmas2023-tests/ecmascript, although somewhere that's not on a branch that would have to be updated yearly is preferable.

@louaybassbouss
Copy link
Author

Thanks @ptomato for your feedback, full agree, we will provide a permanent Link pointing to the lasted release.

@louaybassbouss
Copy link
Author

Thanks @ptomato for your feedback, full agree, we will provide a permanent Link pointing to the lasted release.

@Ms2ger @ptomato this https://github.com/cta-wave/WMAS-deploy/tree/wmas-latest is a stable link which you can use. It points to the latest stable WMAS Test Suite

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants