[Epic] Robust Testing Initiative

[QMalcolm]

Fixture Building+ Major Examples

Preview Give feedback

1. Create unit tests for SemanticManifest supported by a manifest fixture and utility builders #9665
   enhancement +1
   
2. Create Project fixture and unit test Project class #9870
   +0
   
3. Create Profile fixture and rewrite TestRuntimeConfig to use it #9984
   +0
4. Refactor TestRuntimeConfig to use Project fixture #9983
   +0
5. Write a unittest for get_full_manifest #9865
   +0
   
6. Write a unittest for partial parse #9866
   +0
   
7. Create a standard way to check events being fired in Unittest #9947
   +0
   
8. [SPIKE+] Make a plan for how to write a unittest for ModelRunner #9867
   Refinement +1
   
9. [CT-3111] [Tech debt] Create setup fixture for setting flags in unit tests #8627
   tech_debt +1
   
10. Create RuntimeConfig fixture and refactor the current test to use it #10000
    +0
    
11. An example unit test for GraphRunnableTask #10001
    +0
    
12. [SPIKE+] Write a unittest for a simple selection #9868
    +0
    
13. Schedule bash for team to try and convert indivual tests

Happy Path Functional Testing

Preview Give feedback

1. Create "happy path" project fixture and use it for tests/functional/list/test_list.py #10256
   +0
   
2. Use, and extend as necessary, happy path fixture for tests/functional/show/test_show.py #10257
   stale +1
   
3. Use, and extend as necessary, happy path fixture for tests/functional/artifacts/test_artifacts.py #10286
   +0
   
4. Use, and extend as necessary, happy path fixture for tests/functional/graph_selection/test_graph_selection.py #10288
   stale +1
5. Write up documentation on happy path functional testing methodology #10330
   stale +1
   

Parameterized Tests

Preview Give feedback

1. [SPIKE] Identify functional tests that should be parameterized #10181
   stale +1
   
2. Create parameterized test which tries each resource type with the resource_type: selector #10287
   +0
   
3. [SPIKE] How do we parameterize node based functional tests to expand with changing functionality #10328
   stale +1
   
4. Write up documentation on parameterized testing methodology #10331
   stale +1
   

Test Organization

Preview Give feedback

1. [Robust Testing] Reorganize tests to match source code #9961
   tech_debt +1
   

TODO

Preview Give feedback

1. Create DiGraph fixtured and unit test Graph Class #9871
   +0
   
2. Unit test GraphQueue class #9872
   Refinement +1
   
3. [Spike+] Investigate using pyfakefs to speed up testing #9885
   stale +1
4. [refactor] Seperate selection method to make it easier to test
5. Identify functional tests that should be unittest and write guidance
6. [SPIKE] Can we use codecoverage to protect feature sets
7. Features that interacting with each other #10145
   +0
8. CI check whether a unit test is introduced while code is being modified #10329
   +0
   

[github-actions]

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please comment on the issue or else it will be closed in 7 days.