Testing

From HTML WG Wiki

This page explains how to participate in the W3C HTML5 test suite effort. This effort is managed by the HTML5 test suite task force, part of the HTML Working Group.

There are a number of ways to participate. We welcome contributions of new test cases. The more tests we have, the faster we can improve interoperability among Web browsers.

If you wish to join the test suite task force, contact Philippe Le Hégaret <plh@w3.org>.

Contents 1 Discussion 2 Running the test suite 3 Approved tests 4 Writing Tests 5 New tests 6 Bug Reports 6.1 Areas for improvement 7 Release Timeline 8 Conference Calls 8.1 Upcoming meetings

Discussion

• The task force mailing list is public-html-testsuite@w3.org (archive)
• #Conference Calls (held every two weeks)

Running the test suite

• HTML5 Test Suite Conformance Results. Results not yet significant. Test reports are only accepted from user agent (e.g. Web browsers) implementors at this time. Given that this is work in progress, it is not our priority to update those results.
• Run the tests

Approved tests

• Approved HTML tests.
• These have been approved by this task force (not the full HTML WG) according to the task force's HTML5 Test Case Review and Approval Process.

Writing Tests

See the Guidelines for authoring tests.

New tests

• Existing HTML5 tests. The have been submitted in proper format but have not yet been approved by the task force.
• Ideas for new tests. These are ideas but no tests have been submitted yet.
• Submit a test case and learn about the repository.

Bug Reports

• Report a test suite bug
• We track bugs in BugZilla

Areas for improvement

Beyond the question of the number of tests:

• the coverage of the HTML5 features
• the classification per feature of those tests
• the testing harness, to produce as many automatic tests as possible

Release Timeline

The idea is to take test submissions for 4 months and review all submitted tests for 2 months. The goal is to keep up with test submissions and allow people to plan time in their schedule to review tests.

Here is the timeline for the first release:

• October 15, 2011: all tests submitted
• December 15, 2011: all tests will be fixed due to bugs and feedback from the list. Tests that are not complete will get removed from the approved folder. Tests that don't get updated due to feedback will also get removed from the approved folder.

Conference Calls

• The group meets every two weeks, mainly on irc.w3.org:6665, #htmlt
• You may find some of us on the phone at the same time
  • Time 16:00-17:00 UTC (11:00am-12:00pm Boston local)
  • Zakim Bridge +1.617.761.6200, conference 48658

Upcoming meetings

November 15h 29th
December 13th (no meeting on 20th Holiday)
January 3rd 17th 31st