Skip to content

Functional tests

Vinay Rosenberg requested to merge github/fork/Orange-OpenSource/functional-tests into development

Created by: bbert

This PR updates the functional tests.

What has been done:

  • revert intern package to version 3.4.6 to keep compatibility with existing test suites and environment
  • update browser drivers
  • refactoring of all tests suites and usage of asynchronous scripts when using leadfoot to avoid timeout issues we had in the past
  • take as input list of streams from dash-if-reference-player sample's source.json
  • as a 1st test, availability of manifest is checked in order to avoid running tests on streams that are unavailable
  • management of mixed-content issue when testing streams by specifying protocol (http vs https) to be used
  • add command line options to execute specific test suites, on specific streams

TO DO:

  • take as input streams for DASH test vectors
  • integrate functional tests with CircleCI. I tried but unsuccessfully, documentation is rather light on this topic
  • write more tests

However, one can try on its own/side, all is explain in readme file under test/functional folder.

When running these functional tests, we noticed some streams where on error, as already detailed by @jeffcunat in PR #2921.

Regarding mixed-content issues, the best solution would be to provide all test streams in https.

Merge request reports