Gap analysis and Development

Introduction

  • Describe the purpose of this chapter, which includes, but not limited to:
  • Test Case Gaps (analysis)
  • Automation Gaps
  • OpenStack release Comparisons

Openstack Release Comparisons

  • Provide details, preferably in table format, comparing OpenStack releases based on Wallaby baseline for RI-1

Automation Gaps

At the time of writing, the yaml file configuring all RI Jenkins jobs are postprocessed by hand which requires lots of skills especially about Jenkins job builder . The RI Cookbook will be deeply simplified if the deployment scripts are delivered in a new Xtesting -based container as proposed in new RI deployment container . In addition to avoid configuring the jumphost, it will allow generating the Jenkins jobs via a simple yaml file and Xtesting CI .

Test Case Gaps

Anuket has developed many test cases in the different test projects which can quickly improve RC. As listed in RC Test case integration requirements , porting all the existing testcases to Xtesting will unify the test case execution and simplify the test integration as required by RC. Here are all the related issues:

Here are the possible new test cases which could be integrated in the existing Anuket projects to improve RC:

issues requirements
integrate KloudBuster in Functest disk benchmarking
add tempest-stress in Functest stress testing

Framework Gaps

As proposed in port VTP test cases to Xtesting , VTP selected in VNF E2E C&V Framework requires small adaptations to fully fulfill the current RC Test case integration requirements . It seems trivial changes as VTP proposed a REST API but will ensure that both NFVI and VNF testing can be executed in the same CI toolchain very easily.