9. Gaps, Innovation, and Development

The purpose of this chapter is to identify the gaps between what is required for automated deployment of VNFs on Cloud Infrastructure frameworks and the framework offered by OpenStack. Once gaps are identified, the next step will be to propose a plan to address these gaps. The most obvious way to address the gaps will be to propose a set of APIs in the upstream OpenStack community

9.1. The Gap

9.1.1. Autoscaling

With regards to resource autoscaling (gen.scl.01 General Recommendations) it is recommended that the NFVO/VNFM manages the policy and triggers a scale-up or scale-down action based on application telemetry, event, AI, or ML etc. While the use of telemetry and alarming system can trigger a scaling operation based on resource utilisation, without application context this may not provide the granularity or reaction time required by the application. It is therefore suggested that an OpenStack scaling operation is called using an appropriate autoscaling web-hook by the NFVO/VNFM.

For more information on auto-scaling with Heat please see the OpenStack document “Autoscaling with heat [205]”. Please note that the OpenStack Senlin service is still under development with major architectural changes made in the OpenStack Ussuri release.

Please note: physical compute node autoscaling is out of scope.

[1]

Cloud infrastructure reference model. GSMA PRD NG.126 v3.0, 2022.

[2]

Openstack documentation. URL: https://docs.openstack.org/.

[3]

Network functions virtualisation (nfv); infrastructure overview. ETSI GS NFV-INF 001 V1.1.1, January 2015. URL: https://www.etsi.org/deliver/etsi_gs/NFV-INF/001_099/001/01.01.01_60/gs_NFV-INF001v010101p.pdf.

[5]

Open vswitch. URL: https://www.openvswitch.org/.

[6]

OpenStack Community. Openstack wallaby projects. URL: https://docs.openstack.org/wallaby/projects.html.

[7]

Scott O. Bradner. Key words for use in rfcs to indicate requirement levels. RFC 2119, March 1997. URL: https://www.rfc-editor.org/info/rfc2119, doi:10.17487/RFC2119.

[8]

H. Philip White. Center for internet security - password policy guide. 2020. URL: https://www.cisecurity.org/insights/white-papers/cis-password-policy-guide.

[9]

Center for internet security - controls v7.1. URL: https://www.cisecurity.org/controls/cis-controls-list.

[12]

Openstack - neutron plugins and drivers. URL: https://wiki.openstack.org/wiki/Neutron_Plugins_and_Drivers.

[14]

Openstack - configuring the stateful services. URL: https://docs.openstack.org/ha-guide/control-plane-stateful.html.

[15]

Openstack - senlin documentation. URL: https://docs.openstack.org/senlin/wallaby/.

[16]

Openstack - neutron ovs agent support for baremetal with smart nic. URL: https://specs.openstack.org/openstack/neutron-specs/specs/stein/neutron-ovs-agent-support-baremetal-with-smart-nic.html.

[17]

National telecommunications and information administration - software bill of materials. URL: https://ntia.gov/SBOM.

[18]

Center for internet security. URL: https://www.cisecurity.org/.

[19]

Cloud security alliance. URL: https://cloudsecurityalliance.org/.

[20]

Open web application security project - cheat sheet series. URL: https://github.com/OWASP/CheatSheetSeries.

[21]

Open web application security project. URL: https://www.owasp.org.

[22]

Open web application security project - top ten security risks. URL: https://owasp.org/www-project-top-ten/.

[23]

Open web application security project - software maturity model (samm). URL: https://owaspsamm.org/blog/2019/12/20/version2-community-release/.

[24]

Open web application security project - web security testing guide. URL: https://github.com/OWASP/wstg/tree/master/document.

[25]

Iso (international organization for standardization) and iec (international electrotechnical commission) iso/iec 27001:2013. 2013. URL: https://www.iso.org/obp/ui/#iso:std:iso-iec:27001:ed-2:v1:en.

[26]

Iso (international organization for standardization) and iec (international electrotechnical commission) iso/iec 27002:2013. 2013. URL: https://www.iso.org/obp/ui/#iso:std:iso-iec:27002:ed-2:v1:en.

[27]

Iso (international organization for standardization) and iec (international electrotechnical commission) iso/iec 7032:2012. 2012. URL: https://www.iso.org/obp/ui/#iso:std:iso-iec:27032:ed-1:v1:en.

[29]

Openstack cinder driver support matrix. URL: https://docs.openstack.org/cinder/latest/reference/support-matrix.html.

[30]

Tungsten fabric - multicloud multistack sdn. URL: https://tungsten.io.

[32]

Openstack feature support matrix. URL: https://docs.openstack.org/nova/latest/user/support-matrix.html.

[33]

Openstack storage architecture design. URL: https://docs.openstack.org/arch-design/design-storage.html.

[35]

Openstack - hardening the virtualization layers. URL: https://docs.openstack.org/security-guide/compute/hardening-the-virtualization-layers.html.

[36]

Openstack reference architecture for 100, 300 and 500 nodes. URL: https://fuel-ccp.readthedocs.io/en/latest/design/ref_arch_100_nodes.html.

[37]

(dpdk) release notes. URL: http://doc.dpdk.org/guides/rel_notes.

[38]

(dpdk) performance reports. URL: http://core.dpdk.org/perf-reports/.

[39]

Robert Moskowitz, Daniel Karrenberg, Yakov Rekhter, Eliot Lear, and Geert Jan de Groot. Address allocation for private internets. RFC 1918, February 1996. URL: https://www.rfc-editor.org/info/rfc1918, doi:10.17487/RFC1918.

[40]

Openstack - introducing octavia. URL: https://docs.openstack.org/octavia/latest/reference/introduction.html.

[41]

Openstack octavia (load-balancer service). URL: https://governance.openstack.org/tc/reference/projects/octavia.html.

[42]

Openstack/neutron-vpnaas. URL: https://opendev.org/openstack/neutron-vpnaas.

[43]

Openstack neutron: plugins. URL: https://wiki.openstack.org/wiki/Neutron#Plugins.

[45]

Openstack networking api v2.0: list extensions. URL: https://docs.openstack.org/api-ref/network/v2/#list-extensions.

[46]

Openstack networking api v2.0: show extension details. URL: https://docs.openstack.org/api-ref/network/v2/#show-extension-details.

[47]

Openstack neutron/ml2. URL: https://wiki.openstack.org/wiki/Neutron/ML2.

[48]

Openstack cinder driver support matrix. URL: https://docs.openstack.org/cinder/latest/reference/support-matrix.html.

[49]

Openstack (cinder) available drivers. URL: https://docs.openstack.org/cinder/latest/drivers.html.

[50]

Openstack cinder service configuration. URL: https://docs.openstack.org/cinder/latest/configuration/index.html.

[51]

Openstack cinder administration. URL: https://docs.openstack.org/cinder/latest/admin/index.html.

[52]

Ceph - the future of storage. URL: https://ceph.io/en.

[53]

Keystone, the openstack identity service. URL: https://docs.openstack.org/keystone/wallaby/.

[54]

Openstack - welcome to glance's documentation! URL: https://docs.openstack.org/glance/wallaby/.

[55]

Openstack block storage (cinder) documentation. URL: https://docs.openstack.org/cinder/wallaby/.

[56]

Openstack - welcome to swift's documentation! URL: https://docs.openstack.org/swift/wallaby/.

[57]

Openstack - welcome to neutron's documentation! URL: https://docs.openstack.org/neutron/wallaby/.

[58]

Openstack - scenario: high availability using distributed virtual routing (dvr). URL: https://docs.openstack.org/liberty/networking-guide/scenario-dvr-ovs.html.

[59]

Openstack neutron: distributed virtual routing with vrrp. URL: https://docs.openstack.org/neutron/wallaby/admin/config-dvr-ha-snat.html.

[60]

Openstack compute (nova). URL: https://docs.openstack.org/nova/wallaby/.

[61]

Openstack - welcome to ironic's documentation! URL: https://docs.openstack.org/ironic/wallaby/.

[62]

Openstack ironic api reference: bare metal api. URL: https://docs.openstack.org/api-ref/baremetal/.

[63]

Openstack - welcome to the heat documentation! URL: https://docs.openstack.org/heat/wallaby/.

[64]

Horizon: the openstack dashboard project. URL: https://docs.openstack.org/horizon/wallaby/.

[66]

Openstack - placement: modeling with provider trees. URL: https://docs.openstack.org/placement/latest/user/provider-tree.html.

[67]

Openstack - placement usage. URL: https://docs.openstack.org/placement/latest/user/index.html.

[68]

Openstack key manager (barbican). URL: https://docs.openstack.org/barbican/wallaby/.

[69]

Openstack accelerator (cyborg). URL: https://docs.openstack.org/cyborg/wallaby/.

[70]

Openstack compute api guide 2.1.0: server concepts. URL: https://docs.openstack.org/api-guide/compute/server_concepts.html.

[71]

Openstack cyborg support matrix (wallaby). URL: https://docs.openstack.org/cyborg/wallaby/reference/support-matrix.html.

[73]

Openstack cyborg architecture. URL: https://docs.openstack.org/cyborg/latest/user/architecture.html.

[74]

Openstack cyborg setup.cfg (wallaby). URL: https://opendev.org/openstack/cyborg/src/branch/stable/wallaby/setup.cfg.

[75]

Kubernetes. URL: https://kubernetes.io.

[76]

Reference architecture for kubernetes based cloud infrastructure. Anuket RA2. URL: https://cntt.readthedocs.io/projects/ra2/en/latest/index.html.

[77]

Openstack nova: flavors. URL: https://docs.openstack.org/nova/latest/user/flavors.html.

[79]

Openstack - edge computing: next steps in architecture, design and testing. URL: https://www.openstack.org/use-cases/edge-computing/edge-computing-next-steps-in-architecture-design-and-testing.

[80]

Openstack reference architecture for 100, 300 and 500 nodes: services placement summary. URL: https://fuel-ccp.readthedocs.io/en/latest/design/ref_arch_100_nodes.html#services-placement-summary.

[82]

Airship v2. URL: https://www.airshipit.org/.

[83]

Starlingx - deploy your edge cloud now. URL: https://www.starlingx.io/.

[84]

Openstack tripleo. URL: http://opendev.org/openstack/tripleo-common.

[85]

Openstack compute microversions. URL: https://docs.openstack.org/api-guide/compute/microversions.html.

[87]

Identity api v3 extensions. URL: https://docs.openstack.org/api-ref/identity/v3-ext/.

[89]

Image service api. URL: https://docs.openstack.org/api-ref/image/v2/.

[95]

Networking service apis. URL: https://docs.openstack.org/api-ref/network/.

[96]

Networking api v2.0. URL: https://docs.openstack.org/api-ref/network/v2/.

[101]

Orchestration service api. URL: https://docs.openstack.org/api-ref/orchestration/.

[103]

Heat orchestration template (hot) specification. URL: https://docs.openstack.org/heat/latest/template_guide/hot_spec.html#rocky.

[104]

Openstack apis. URL: https://docs.openstack.org/api-ref/.

[107]

Libvirt apis. URL: https://libvirt.org/html/index.html.

[111]

Mitre - common vulnerabilities and exposures. URL: https://cve.mitre.org/.

[112]

National institute of standards and technology vulnerabilities metrics. URL: https://nvd.nist.gov/vuln-metrics/cvss.

[113]

Openstack security guide - identity. URL: https://docs.openstack.org/security-guide/identity.html.

[114]

Openstack security guide - authentication methods. URL: https://docs.openstack.org/security-guide/identity/authentication-methods.html.

[118]

Center for internet security cis-cat pro. URL: https://www.cisecurity.org/cybersecurity-tools/cis-cat-pro/.

[119]

Center for internet security benchmarks. URL: https://www.cisecurity.org/cis-benchmarks/.

[120]

Openstack image signature verification. URL: https://docs.openstack.org/glance/wallaby/user/signature.html.

[121]

Openstack - sr-iov passthrough for networking. URL: https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking.

[123]

Openstack virtual machine image guide. URL: https://docs.openstack.org/image-guide/.

[125]

Network functions virtualisation (nfv) release 4; protocols and data models; vnf package and pnfd archive specification. ETSI GS NFV-SOL 004 V4.3.1, July 2022. URL: https://www.etsi.org/deliver/etsi_gs/NFV-SOL/001_099/004/04.03.01_60/gs_NFV-SOL004v040301p.pdf.

[126]

Network functions virtualisation (nfv) release 2; security; vnf package security specification. ETSI GS NFV-SEC 021 V2.6.1, June 2019. URL: https://www.etsi.org/deliver/etsi_gs/NFV-SEC/001_099/021/02.06.01_60/gs_nfv-sec021v020601p.pdf.

[127]

Foreman. URL: https://www.theforeman.org/.

[128]

Ansible documentation. URL: https://docs.ansible.com/.

[131]

Jenkins. URL: https://build.opnfv.org/.

[133]

S3 compatible storage service. URL: http://artifacts.opnfv.org/.

[136]

Docker. URL: https://www.docker.com/.

[139]

Xtesting python package. URL: https://pypi.org/project/xtesting/.

[141]

Ci/cd toolchains in a few commands. URL: https://github.com/collivier/ansible-role-xtesting#readme.

[142]

Ci/cd deployment models. URL: https://lists.opnfv.org/g/opnfv-tsc/message/5702.

[144]

Test case result dump. URL: http://artifacts.opnfv.org/functest/9ID39XK47PMZ.zip.

[150]

Refstack. URL: https://refstack.openstack.org/.

[155]

Temptest. URL: https://github.com/openstack/tempest.

[157]

Raspberry pi. URL: https://www.raspberrypi.org/.

[160]

Run alpine functest containers (wallaby). URL: https://wiki.anuket.io/display/HOME/Functest+Wallaby.

[161]

Functest gates. URL: https://build.opnfv.org/ci/view/functest.

[162]

New functest cntt containers. URL: https://lists.opnfv.org/g/opnfv-tsc/message/5717.

[163]

Keystone-tempest-plugin. URL: https://opendev.org/openstack/keystone-tempest-plugin.

[165]

Cinder-tempest-plugin. URL: https://opendev.org/openstack/cinder-tempest-plugin.

[166]

Functest review 68881. URL: https://gerrit.opnfv.org/gerrit/68881.

[167]

Functest review 71011. URL: https://gerrit.opnfv.org/gerrit/71011.

[168]

Openstack bug 1770179. URL: https://launchpad.net/bugs/1770179.

[169]

Openstack bug 1677525. URL: https://launchpad.net/bugs/1677525.

[170]

Openstack bug 1317133. URL: https://launchpad.net/bugs/1317133.

[171]

Openstack bug 1905432. URL: https://launchpad.net/bugs/1905432.

[172]

Neutron-tempest-plugin. URL: https://opendev.org/openstack/neutron-tempest-plugin.

[173]

Openstack bug 1863707. URL: https://launchpad.net/bugs/1863707.

[174]

Functest review 69105. URL: https://gerrit.opnfv.org/gerrit/69105.

[175]

Openstack bug 1676207. URL: https://launchpad.net/bugs/1676207.

[176]

Openstack bug 1836595. URL: https://launchpad.net/bugs/1836595.

[177]

Openstack bug 1186354. URL: https://launchpad.net/bugs/1186354.

[178]

Openstack bug 1014647. URL: https://launchpad.net/bugs/1014647.

[179]

Openstack bug 1311500. URL: https://launchpad.net/bugs/1311500.

[180]

Openstack bug 1161411. URL: https://launchpad.net/bugs/1161411.

[181]

Openstack bug 1540645. URL: https://launchpad.net/bugs/1540645.

[182]

Heat-tempest-plugin. URL: https://opendev.org/openstack/heat-tempest-plugin.

[183]

Openstack story 2007804. URL: https://storyboard.openstack.org/#!/story/2007804.

[184]

Functest review 69926. URL: https://gerrit.opnfv.org/gerrit/69926.

[185]

Functest review 69931. URL: https://gerrit.opnfv.org/gerrit/69931.

[186]

Functest review 70004. URL: https://gerrit.opnfv.org/gerrit/70004.

[187]

Tempest-horizon. URL: https://github.com/openstack/tempest-horizon.

[198]

Clearwater ims. URL: https://clearwater.readthedocs.io/en/stable/.

[199]

Vyos vrouter. URL: https://www.vyos.io/.

[200]

Openairinterface vepc. URL: https://www.openairinterface.org/.

[201]

Cloudify. URL: https://cloudify.co.

[202]

Juju. URL: https://jaas.ai/.

[203]

Clearwater-live-test. URL: https://github.com/Metaswitch/clearwater-live-test.