Testing #893
Updated by Hammel over 1 year ago
Feature development is essentially complete for the PiBox 2.0 - Harkonnen release. However, full integration tests need to be run to validate existing functionality passes regression and new features are at least stable, if not bug free.
The following systems need to be fully tested. A test plan has been written for each one. Separate issues will be written for each testplan and test status will be tracked here. *_Platforms_* represent the devices on which the system was tested.
|\2=.**Test Suite** |\6=.**Platforms** |
|_.System |_.Test Plan |_.RPi 1 |_.RPi 2 |_.RPi 3 |_.Zero (3) |_.Zero W (3) |_.Desktop |
| Dev Platform | [[DevPlatform]] |={background-color:#cfc}.Pass |={background-color:#cfc}.Pass |={background-color:#cfc}.Pass |={background-color:#cfc}.Pass |={background-color:#cfc}.Pass |={background-color:#ccc}.n/a |
| Media System | [[MediaSystem]] |={background-color:#ccc}.n/a |={background-color:#cfc}.Pass |={background-color:#cfc}.Pass |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |
| Media Player (5) | [[Media_Player]] |={background-color:#cfc}.Pass |={background-color:#cfc}.Pass |={background-color:#cfc}.Pass |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |
| Kiosk | [[Kiosk]] |={background-color:#dda}.Warn |={background-color:#dda}.Warn |={background-color:#dda}.Warn |={background-color:#ffc}.Warn |={background-color:#ffc}.Warn |={background-color:#ffc}.Warn |={background-color:#fcc}.Fail(1,2) |={background-color:#fcc}.Fail(1,2) |={background-color:#ccc}.n/a |
| Auto Kiosk | [[Auto_Kiosk]] |={background-color:#ccc}.n/a |={background-color:#fff}. |={background-color:#fff}. |={background-color:#fff}. |={background-color:#fff}. |={background-color:#ccc}.n/a |
| PiStore | [[PiStore]] |={background-color:#ccc}.n/a |={background-color:#fff}. |={background-color:#fff}. |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |
| PiSentry | [[PiStore]] |={background-color:#ccc}.n/a |={background-color:#fff}. |={background-color:#fff}. |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |
| Desktop (VideoLib) | [[VideoLib]] |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |={background-color:#ccc}.n/a |={background-color:#fff}. |
h3. Platform Notes
# This is the first full test suite run on system builds, as system builds are new to this release. This means there really isn't any regression testing and all tests are new feature testing.
# These tests were started in September 2022. Supply chain issues make "acquisition of new boards":https://rpilocator.com/ nearly impossible unless you get on a wait list. Replacing dead boards won't happen for awhile, I think.
# The Zero and Zero W can't be used with a WiFI dongle, which tend to pull too much power from that board. They are limited to use with Kiosk and AutoKiosk systems.
# Media Player works better if Media Server is wired to an access point instead of being the access point.
h3{background-color:#dda;}. h3{background-color:#ffc;}. Notes on Warn Tests
# Tests in Warn status require fixes before the 2.0 release can be made. Check "PiBox issue tracker":https://redmine.graphics-muse.org/projects/pibox/issues?query_id=12.
h3{background-color:#fcc;}. Notes on Failed Tests
# There is no platform enclosure for Pi Zero/Zero W for Kiosk and AutoKiosk, ie there is no enclosure for the Zero's with an HDMI display. These were tested using a small 5" HDMI touchscreen display without any enclosure for the Zero or display. They were also tested with a standard HDMI desktop display.
# Pi Zero and Pi Zero W failed use of both touch screen and desktop displays and both wired and wireless keyboards. These systems will be a focus for the next release and are marked as failed for this release.
h3{background-color:#cfc;}. Notes on Passed Tests
# Caveats listed in comment #note-8.
h3. Test Summaries
* Based on test results for PiBox 2.0, PiBox 3.0 will focus on, but is not limited to, the following items.
** Pi Zero / Pi Zero W support
** Integrate use of GPU for drawing to speed up display on Zero's and Pi 1's.
** More flexible display handling for touchscreens.
** Possibly adding sensor systems on Zero/Zero W boards to integrate with the Ironman project.