9. Gaps, Innovation, and Development¶
The purpose of this chapter is to identify the gaps between what is required for automated deployment of VNFs on Cloud Infrastructure frameworks and the framework offered by OpenStack. Once gaps are identified, the next step will be to propose a plan to address these gaps. The most obvious way to address the gaps will be to propose a set of APIs in the upstream OpenStack community
9.1. The Gap¶
9.1.1. Autoscaling¶
With regards to resource autoscaling (gen.scl.01 General Recommendations) it is recommended that the NFVO/VNFM manages the policy and triggers a scale-up or scale-down action based on application telemetry, event, AI, or ML etc. While the use of telemetry and alarming system can trigger a scaling operation based on resource utilisation, without application context this may not provide the granularity or reaction time required by the application. It is therefore suggested that an OpenStack scaling operation is called using an appropriate autoscaling web-hook by the NFVO/VNFM.
For more information on auto-scaling with Heat please see the OpenStack document “Autoscaling with heat [205]”. Please note that the OpenStack Senlin service is still under development with major architectural changes made in the OpenStack Ussuri release.
Please note: physical compute node autoscaling is out of scope.
Cloud infrastructure reference model. GSMA PRD NG.126 v3.0, 2022.
Openstack documentation. URL: https://docs.openstack.org/.
Network functions virtualisation (nfv); infrastructure overview. ETSI GS NFV-INF 001 V1.1.1, January 2015. URL: https://www.etsi.org/deliver/etsi_gs/NFV-INF/001_099/001/01.01.01_60/gs_NFV-INF001v010101p.pdf.
Openstack use cases. URL: https://docs.openstack.org/arch-design/use-cases.html.
Open vswitch. URL: https://www.openvswitch.org/.
OpenStack Community. Openstack wallaby projects. URL: https://docs.openstack.org/wallaby/projects.html.
Scott O. Bradner. Key words for use in rfcs to indicate requirement levels. RFC 2119, March 1997. URL: https://www.rfc-editor.org/info/rfc2119, doi:10.17487/RFC2119.
H. Philip White. Center for internet security - password policy guide. 2020. URL: https://www.cisecurity.org/insights/white-papers/cis-password-policy-guide.
Center for internet security - controls v7.1. URL: https://www.cisecurity.org/controls/cis-controls-list.
Openstack - cpu dedicated set. URL: https://docs.openstack.org/nova/latest/configuration/config.html#compute.cpu_dedicated_set.
Openstack - cpu topologies. URL: https://docs.openstack.org/nova/latest/admin/cpu-topologies.html.
Openstack - neutron plugins and drivers. URL: https://wiki.openstack.org/wiki/Neutron_Plugins_and_Drivers.
Openstack - tags. URL: https://specs.openstack.org/openstack/api-wg/guidelines/tags.html.
Openstack - configuring the stateful services. URL: https://docs.openstack.org/ha-guide/control-plane-stateful.html.
Openstack - senlin documentation. URL: https://docs.openstack.org/senlin/wallaby/.
Openstack - neutron ovs agent support for baremetal with smart nic. URL: https://specs.openstack.org/openstack/neutron-specs/specs/stein/neutron-ovs-agent-support-baremetal-with-smart-nic.html.
National telecommunications and information administration - software bill of materials. URL: https://ntia.gov/SBOM.
Center for internet security. URL: https://www.cisecurity.org/.
Cloud security alliance. URL: https://cloudsecurityalliance.org/.
Open web application security project - cheat sheet series. URL: https://github.com/OWASP/CheatSheetSeries.
Open web application security project. URL: https://www.owasp.org.
Open web application security project - top ten security risks. URL: https://owasp.org/www-project-top-ten/.
Open web application security project - software maturity model (samm). URL: https://owaspsamm.org/blog/2019/12/20/version2-community-release/.
Open web application security project - web security testing guide. URL: https://github.com/OWASP/wstg/tree/master/document.
Iso (international organization for standardization) and iec (international electrotechnical commission) iso/iec 27001:2013. 2013. URL: https://www.iso.org/obp/ui/#iso:std:iso-iec:27001:ed-2:v1:en.
Iso (international organization for standardization) and iec (international electrotechnical commission) iso/iec 27002:2013. 2013. URL: https://www.iso.org/obp/ui/#iso:std:iso-iec:27002:ed-2:v1:en.
Iso (international organization for standardization) and iec (international electrotechnical commission) iso/iec 7032:2012. 2012. URL: https://www.iso.org/obp/ui/#iso:std:iso-iec:27032:ed-1:v1:en.
Openstack storage. URL: https://docs.openstack.org/arch-design/design-storage/design-storage-concepts.html#table-openstack-storage.
Openstack cinder driver support matrix. URL: https://docs.openstack.org/cinder/latest/reference/support-matrix.html.
Tungsten fabric - multicloud multistack sdn. URL: https://tungsten.io.
Openstack glossary. URL: https://docs.openstack.org/doc-contrib-guide/common/glossary.html.
Openstack feature support matrix. URL: https://docs.openstack.org/nova/latest/user/support-matrix.html.
Openstack storage architecture design. URL: https://docs.openstack.org/arch-design/design-storage.html.
Openstack nova: kvm. URL: https://docs.openstack.org/nova/wallaby/admin/configuration/hypervisor-kvm.html.
Openstack - hardening the virtualization layers. URL: https://docs.openstack.org/security-guide/compute/hardening-the-virtualization-layers.html.
Openstack reference architecture for 100, 300 and 500 nodes. URL: https://fuel-ccp.readthedocs.io/en/latest/design/ref_arch_100_nodes.html.
(dpdk) release notes. URL: http://doc.dpdk.org/guides/rel_notes.
(dpdk) performance reports. URL: http://core.dpdk.org/perf-reports/.
Robert Moskowitz, Daniel Karrenberg, Yakov Rekhter, Eliot Lear, and Geert Jan de Groot. Address allocation for private internets. RFC 1918, February 1996. URL: https://www.rfc-editor.org/info/rfc1918, doi:10.17487/RFC1918.
Openstack - introducing octavia. URL: https://docs.openstack.org/octavia/latest/reference/introduction.html.
Openstack octavia (load-balancer service). URL: https://governance.openstack.org/tc/reference/projects/octavia.html.
Openstack/neutron-vpnaas. URL: https://opendev.org/openstack/neutron-vpnaas.
Openstack neutron: plugins. URL: https://wiki.openstack.org/wiki/Neutron#Plugins.
Openstack neutron: api extensions. URL: https://docs.openstack.org/neutron/latest/contributor/internals/api_extensions.html.
Openstack networking api v2.0: list extensions. URL: https://docs.openstack.org/api-ref/network/v2/#list-extensions.
Openstack networking api v2.0: show extension details. URL: https://docs.openstack.org/api-ref/network/v2/#show-extension-details.
Openstack neutron/ml2. URL: https://wiki.openstack.org/wiki/Neutron/ML2.
Openstack cinder driver support matrix. URL: https://docs.openstack.org/cinder/latest/reference/support-matrix.html.
Openstack (cinder) available drivers. URL: https://docs.openstack.org/cinder/latest/drivers.html.
Openstack cinder service configuration. URL: https://docs.openstack.org/cinder/latest/configuration/index.html.
Openstack cinder administration. URL: https://docs.openstack.org/cinder/latest/admin/index.html.
Ceph - the future of storage. URL: https://ceph.io/en.
Keystone, the openstack identity service. URL: https://docs.openstack.org/keystone/wallaby/.
Openstack - welcome to glance's documentation! URL: https://docs.openstack.org/glance/wallaby/.
Openstack block storage (cinder) documentation. URL: https://docs.openstack.org/cinder/wallaby/.
Openstack - welcome to swift's documentation! URL: https://docs.openstack.org/swift/wallaby/.
Openstack - welcome to neutron's documentation! URL: https://docs.openstack.org/neutron/wallaby/.
Openstack - scenario: high availability using distributed virtual routing (dvr). URL: https://docs.openstack.org/liberty/networking-guide/scenario-dvr-ovs.html.
Openstack neutron: distributed virtual routing with vrrp. URL: https://docs.openstack.org/neutron/wallaby/admin/config-dvr-ha-snat.html.
Openstack compute (nova). URL: https://docs.openstack.org/nova/wallaby/.
Openstack - welcome to ironic's documentation! URL: https://docs.openstack.org/ironic/wallaby/.
Openstack ironic api reference: bare metal api. URL: https://docs.openstack.org/api-ref/baremetal/.
Openstack - welcome to the heat documentation! URL: https://docs.openstack.org/heat/wallaby/.
Horizon: the openstack dashboard project. URL: https://docs.openstack.org/horizon/wallaby/.
Openstack - placement. URL: https://docs.openstack.org/placement/wallaby/index.html.
Openstack - placement: modeling with provider trees. URL: https://docs.openstack.org/placement/latest/user/provider-tree.html.
Openstack - placement usage. URL: https://docs.openstack.org/placement/latest/user/index.html.
Openstack key manager (barbican). URL: https://docs.openstack.org/barbican/wallaby/.
Openstack accelerator (cyborg). URL: https://docs.openstack.org/cyborg/wallaby/.
Openstack compute api guide 2.1.0: server concepts. URL: https://docs.openstack.org/api-guide/compute/server_concepts.html.
Openstack cyborg support matrix (wallaby). URL: https://docs.openstack.org/cyborg/wallaby/reference/support-matrix.html.
Openstack cyborg support matrix. URL: https://docs.openstack.org/cyborg/latest/reference/support-matrix.html.
Openstack cyborg architecture. URL: https://docs.openstack.org/cyborg/latest/user/architecture.html.
Openstack cyborg setup.cfg (wallaby). URL: https://opendev.org/openstack/cyborg/src/branch/stable/wallaby/setup.cfg.
Kubernetes. URL: https://kubernetes.io.
Reference architecture for kubernetes based cloud infrastructure. Anuket RA2. URL: https://cntt.readthedocs.io/projects/ra2/en/latest/index.html.
Openstack nova: flavors. URL: https://docs.openstack.org/nova/latest/user/flavors.html.
Open glossary of edge computing. URL: https://github.com/State-of-the-Edge/glossary/blob/master/edge-glossary.md.
Openstack - edge computing: next steps in architecture, design and testing. URL: https://www.openstack.org/use-cases/edge-computing/edge-computing-next-steps-in-architecture-design-and-testing.
Openstack reference architecture for 100, 300 and 500 nodes: services placement summary. URL: https://fuel-ccp.readthedocs.io/en/latest/design/ref_arch_100_nodes.html#services-placement-summary.
Openstack nova: image pre-caching. URL: https://docs.openstack.org/nova/latest/admin/image-caching.html#image-pre-caching.
Airship v2. URL: https://www.airshipit.org/.
Starlingx - deploy your edge cloud now. URL: https://www.starlingx.io/.
Openstack tripleo. URL: http://opendev.org/openstack/tripleo-common.
Openstack compute microversions. URL: https://docs.openstack.org/api-guide/compute/microversions.html.
Identity api v3. URL: https://docs.openstack.org/api-ref/identity/v3/index.html.
Identity api v3 extensions. URL: https://docs.openstack.org/api-ref/identity/v3-ext/.
Security compliance and pci-dss. URL: https://docs.openstack.org/keystone/wallaby/admin/configuration.html#security-compliance-and-pci-dss.
Image service api. URL: https://docs.openstack.org/api-ref/image/v2/.
Image service versions. URL: https://docs.openstack.org/api-ref/image/versions/index.html#version-history.
Block storage api. URL: https://docs.openstack.org/api-ref/block-storage/.
Cinder rest api version history. URL: https://docs.openstack.org/cinder/latest/contributor/api_microversion_history.html.
Object storage api. URL: https://docs.openstack.org/api-ref/object-store/index.html.
Discoverability. URL: https://docs.openstack.org/swift/latest/api/discoverability.html.
Networking service apis. URL: https://docs.openstack.org/api-ref/network/.
Networking api v2.0. URL: https://docs.openstack.org/api-ref/network/v2/.
Compute api. URL: https://docs.openstack.org/api-ref/compute/.
Compute rest api version history. URL: https://docs.openstack.org/nova/latest/reference/api-microversion-history.html.
Placement api. URL: https://docs.openstack.org/api-ref/placement/.
Placement rest api version history. URL: https://docs.openstack.org/placement/latest/placement-api-microversion-history.html.
Orchestration service api. URL: https://docs.openstack.org/api-ref/orchestration/.
Template version history. URL: https://docs.openstack.org/heat/latest/template_guide/hot_spec.html.
Heat orchestration template (hot) specification. URL: https://docs.openstack.org/heat/latest/template_guide/hot_spec.html#rocky.
Openstack apis. URL: https://docs.openstack.org/api-ref/.
Kubernetes apis. URL: https://kubernetes.io/docs/concepts/overview/kubernetes-api/.
Kvm apis. URL: https://www.kernel.org/doc/Documentation/virtual/kvm/api.txt.
Libvirt apis. URL: https://libvirt.org/html/index.html.
Barbican api. URL: https://docs.openstack.org/barbican/latest/api/.
Openstack - security boundaries and threats. URL: https://docs.openstack.org/security-guide/introduction/security-boundaries-and-threats.html.
Openstack security guide. URL: https://docs.openstack.org/security-guide/introduction/introduction-to-openstack.html.
Mitre - common vulnerabilities and exposures. URL: https://cve.mitre.org/.
National institute of standards and technology vulnerabilities metrics. URL: https://nvd.nist.gov/vuln-metrics/cvss.
Openstack security guide - identity. URL: https://docs.openstack.org/security-guide/identity.html.
Openstack security guide - authentication methods. URL: https://docs.openstack.org/security-guide/identity/authentication-methods.html.
Openstack security guide - policies. URL: https://docs.openstack.org/security-guide/identity/policies.html#policy-section.
Openstack keystone default roles. URL: https://docs.openstack.org/keystone/latest/admin/service-api-protection.html.
Openstack - introduction to tls and ssl. URL: https://docs.openstack.org/security-guide/secure-communication/introduction-to-ssl-and-tls.html.
Center for internet security cis-cat pro. URL: https://www.cisecurity.org/cybersecurity-tools/cis-cat-pro/.
Center for internet security benchmarks. URL: https://www.cisecurity.org/cis-benchmarks/.
Openstack image signature verification. URL: https://docs.openstack.org/glance/wallaby/user/signature.html.
Openstack - sr-iov passthrough for networking. URL: https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking.
Openstack trusted images. URL: https://docs.openstack.org/security-guide/instance-management/security-services-for-instances.html#trusted-images.
Openstack virtual machine image guide. URL: https://docs.openstack.org/image-guide/.
Adding signed images. URL: https://docs.openstack.org/operations-guide/ops-user-facing-operations.html#adding-signed-images.
Network functions virtualisation (nfv) release 4; protocols and data models; vnf package and pnfd archive specification. ETSI GS NFV-SOL 004 V4.3.1, July 2022. URL: https://www.etsi.org/deliver/etsi_gs/NFV-SOL/001_099/004/04.03.01_60/gs_NFV-SOL004v040301p.pdf.
Network functions virtualisation (nfv) release 2; security; vnf package security specification. ETSI GS NFV-SEC 021 V2.6.1, June 2019. URL: https://www.etsi.org/deliver/etsi_gs/NFV-SEC/001_099/021/02.06.01_60/gs_nfv-sec021v020601p.pdf.
Foreman. URL: https://www.theforeman.org/.
Ansible documentation. URL: https://docs.ansible.com/.
Openstack tripleo architecture. URL: https://docs.openstack.org/tripleo-docs/latest/install/introduction/architecture.html#project-architecture.
Ovp. URL: https://www.opnfv.org/verification.
Jenkins. URL: https://build.opnfv.org/.
Test dabase. URL: https://docs.opnfv.org/en/stable-hunter/_images/OPNFV_testing_working_group.png.
S3 compatible storage service. URL: http://artifacts.opnfv.org/.
Functest-wallaby-zip. URL: https://build.opnfv.org/ci/job/functest-wallaby-zip/4/console.
Xtesting ci. URL: https://galaxy.ansible.com/collivier/xtesting.
Docker. URL: https://www.docker.com/.
Xtesting. URL: https://xtesting.readthedocs.io/en/latest/.
Opnfv fraser. URL: https://www.sdxcentral.com/articles/news/opnfvs-6th-release-brings-testing-capabilities-that-orange-is-already-using/2018/05/.
Xtesting python package. URL: https://pypi.org/project/xtesting/.
Test case execution description. URL: https://git.opnfv.org/functest-xtesting/tree/docker/core/testcases.yaml.
Ci/cd toolchains in a few commands. URL: https://github.com/collivier/ansible-role-xtesting#readme.
Ci/cd deployment models. URL: https://lists.opnfv.org/g/opnfv-tsc/message/5702.
Anuket releng. URL: https://git.opnfv.org/releng/tree/jjb/functest.
Test case result dump. URL: http://artifacts.opnfv.org/functest/9ID39XK47PMZ.zip.
Xtesting samples. URL: https://git.opnfv.org/functest-xtesting/plain/ansible/site.yml?h=stable/wallaby.
Openstack verification. URL: https://git.opnfv.org/functest/plain/ansible/site.yml?h=stable/wallaby.
Anuket rc1. URL: https://git.opnfv.org/functest/plain/ansible/site.cntt.yml?h=stable/wallaby.
Kubernetes verification. URL: https://git.opnfv.org/functest-kubernetes/plain/ansible/site.yml?h=stable/v1.22.
Functest. URL: https://functest.readthedocs.io/en/stable-wallaby/.
Refstack. URL: https://refstack.openstack.org/.
Networking bgpvpn. URL: https://docs.openstack.org/networking-bgpvpn/latest/.
Networking sfc. URL: https://docs.openstack.org/networking-sfc/latest/.
Devstack gates. URL: https://docs.opendev.org/opendev/system-config/latest/devstack-gate.html.
Rally. URL: https://github.com/openstack/rally-openstack.
Temptest. URL: https://github.com/openstack/tempest.
Temptest. URL: https://docs.openstack.org/devstack/latest/.
Raspberry pi. URL: https://www.raspberrypi.org/.
Functest daily jobs. URL: https://build.opnfv.org/ci/view/functest/job/functest-wallaby-daily/17/.
Openstack performance tools. URL: https://docs.openstack.org/developer/performance-docs/methodologies/tools.html.
Run alpine functest containers (wallaby). URL: https://wiki.anuket.io/display/HOME/Functest+Wallaby.
Functest gates. URL: https://build.opnfv.org/ci/view/functest.
New functest cntt containers. URL: https://lists.opnfv.org/g/opnfv-tsc/message/5717.
Keystone-tempest-plugin. URL: https://opendev.org/openstack/keystone-tempest-plugin.
Functest smoke cntt. URL: https://git.opnfv.org/functest/tree/docker/smoke-cntt/testcases.yaml?h=stable%2Fwallaby.
Cinder-tempest-plugin. URL: https://opendev.org/openstack/cinder-tempest-plugin.
Functest review 68881. URL: https://gerrit.opnfv.org/gerrit/68881.
Functest review 71011. URL: https://gerrit.opnfv.org/gerrit/71011.
Openstack bug 1770179. URL: https://launchpad.net/bugs/1770179.
Openstack bug 1677525. URL: https://launchpad.net/bugs/1677525.
Openstack bug 1317133. URL: https://launchpad.net/bugs/1317133.
Openstack bug 1905432. URL: https://launchpad.net/bugs/1905432.
Neutron-tempest-plugin. URL: https://opendev.org/openstack/neutron-tempest-plugin.
Openstack bug 1863707. URL: https://launchpad.net/bugs/1863707.
Functest review 69105. URL: https://gerrit.opnfv.org/gerrit/69105.
Openstack bug 1676207. URL: https://launchpad.net/bugs/1676207.
Openstack bug 1836595. URL: https://launchpad.net/bugs/1836595.
Openstack bug 1186354. URL: https://launchpad.net/bugs/1186354.
Openstack bug 1014647. URL: https://launchpad.net/bugs/1014647.
Openstack bug 1311500. URL: https://launchpad.net/bugs/1311500.
Openstack bug 1161411. URL: https://launchpad.net/bugs/1161411.
Openstack bug 1540645. URL: https://launchpad.net/bugs/1540645.
Heat-tempest-plugin. URL: https://opendev.org/openstack/heat-tempest-plugin.
Openstack story 2007804. URL: https://storyboard.openstack.org/#!/story/2007804.
Functest review 69926. URL: https://gerrit.opnfv.org/gerrit/69926.
Functest review 69931. URL: https://gerrit.opnfv.org/gerrit/69931.
Functest review 70004. URL: https://gerrit.opnfv.org/gerrit/70004.
Tempest-horizon. URL: https://github.com/openstack/tempest-horizon.
Functest healthcheck. URL: https://git.opnfv.org/functest/tree/docker/healthcheck/testcases.yaml?h=stable%2Fwallaby.
Functest benchmarking cntt. URL: https://git.opnfv.org/functest/tree/docker/benchmarking-cntt/testcases.yaml?h=stable%2Fwallaby.
Rally_full_cntt. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-cntt-wallaby-rally_full_cntt-run-5/rally_full_cntt/rally_full_cntt.html.
Rally_jobs_cntt. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-cntt-wallaby-rally_jobs_cntt-run-5/rally_jobs_cntt/rally_jobs_cntt.html.
Vmtp. URL: http://vmtp.readthedocs.io/en/latest.
Shaker. URL: https://pyshaker.readthedocs.io/en/latest/.
Vmtp scenarios. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-wallaby-vmtp-run-8/vmtp/vmtp.json.
Functest vmtp. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-wallaby-vmtp-run-8/vmtp/vmtp.html.
Shaker scenarios. URL: http://artifacts.opnfv.org/functest/KDBNITEN317M/functest-opnfv-functest-benchmarking-wallaby-shaker-run-8/shaker/report.json.
Functest vnf. URL: https://git.opnfv.org/functest/tree/docker/vnf/testcases.yaml?h=stable%2Fwallaby.
Clearwater ims. URL: https://clearwater.readthedocs.io/en/stable/.
Vyos vrouter. URL: https://www.vyos.io/.
Openairinterface vepc. URL: https://www.openairinterface.org/.
Cloudify. URL: https://cloudify.co.
Juju. URL: https://jaas.ai/.
Clearwater-live-test. URL: https://github.com/Metaswitch/clearwater-live-test.
Docker http/https proxy. URL: https://docs.docker.com/config/daemon/systemd/#httphttps-proxy.
Openstack autoscaling with heat. URL: https://docs.openstack.org/senlin/latest/scenarios/autoscaling_heat.html.