Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Error installing SD-RAN 1.4 onos-e2t CrashLoopBackOff protocol not supported #1142

Open
avivbd opened this issue Apr 3, 2023 · 0 comments
Open

Error installing SD-RAN 1.4 onos-e2t CrashLoopBackOff protocol not supported #1142

avivbd opened this issue Apr 3, 2023 · 0 comments

Comments

@avivbd
Copy link

avivbd commented Apr 3, 2023

Trying to install sd-ran 1.4 as per the documentation. Environment is generic AKS.

  1. Getting some interesting warnings
W0403 19:41:53.777568     428 warnings.go:70] spec.template.metadata.annotations[seccomp.security.alpha.kubernetes.io/pod]: deprecated since v1.19, non-functional in v1.25+; use the "seccompProfile" field instead
W0403 19:41:53.807099     428 warnings.go:70] spec.template.metadata.annotations[seccomp.security.alpha.kubernetes.io/pod]: deprecated since v1.19, non-functional in v1.25+; use the "seccompProfile" field instead
NAME: sd-ran
LAST DEPLOYED: Mon Apr  3 19:41:51 2023
NAMESPACE: sdran
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Thank you for installing sd-ran Helm chart.
  1. Getting failed pod:
NAME                           READY   STATUS             RESTARTS     AGE
onos-a1t-7b9889cd4-xpqbp       1/2     Running            0            20s
onos-cli-5dd998fcdc-56kgz      1/1     Running            0            20s
onos-config-74f455d895-65g9m   4/4     Running            0            20s
onos-consensus-store-0         1/1     Running            0            20s
onos-e2t-b8cfc66c4-nx5x9       2/3     CrashLoopBackOff   1 (5s ago)   20s
onos-topo-75fdc5dbbd-ptkgd     3/3     Running            0            20s
onos-uenib-6bdb5b685c-6cqcn    3/3     Running            0            20s
  1. Events for that pod:
  Type     Reason                Age                    From               Message
  ----     ------                ----                   ----               -------
  Normal   Scheduled             2m33s                  default-scheduler  Successfully assigned sdran/onos-e2t-b8cfc66c4-nx5x9 to aks-nodepool1-91329116-vmss000000
  Normal   Pulled                2m31s                  kubelet            Container image "onosproject/service-model-docker-e2sm_rc_pre_go-1.0.0:v0.8.7" already present on machine
  Normal   Created               2m31s                  kubelet            Created container service-model-e2sm-rc-pre-go-1-0-0
  Normal   Started               2m31s                  kubelet            Started container service-model-e2sm-rc-pre-go-1-0-0
  Normal   Pulled                2m30s                  kubelet            Container image "onosproject/service-model-docker-e2sm_kpm_v2_go-1.0.0:v0.8.7" already present on machine
  Normal   Created               2m30s                  kubelet            Created container service-model-e2sm-kpm-v2-go-1-0-0
  Normal   Started               2m30s                  kubelet            Started container service-model-e2sm-kpm-v2-go-1-0-0
  Normal   Pulled                2m29s                  kubelet            Container image "onosproject/service-model-docker-e2sm_mho_go-1.0.0:v0.8.7" already present on machine
  Normal   Created               2m29s                  kubelet            Created container service-model-e2sm-mho-go-1-0-0
  Normal   Started               2m29s                  kubelet            Started container service-model-e2sm-mho-go-1-0-0
  Normal   Pulled                2m28s                  kubelet            Container image "onosproject/service-model-docker-e2sm_rsm-1.0.0:v0.8.7" already present on machine
  Normal   Created               2m28s                  kubelet            Created container service-model-e2sm-rsm-1-0-0
  Normal   Started               2m28s                  kubelet            Started container service-model-e2sm-rsm-1-0-0
  Normal   Pulled                2m27s                  kubelet            Container image "atomix/atomix-broker:v0.6.2" already present on machine
  Normal   Created               2m27s                  kubelet            Created container atomix-broker
  Normal   Pulled                2m26s                  kubelet            Container image "atomix/atomix-raft-storage-driver:v0.9.19" already present on machine
  Normal   Started               2m26s                  kubelet            Started container driver-raft-v2beta2
  Normal   Created               2m26s                  kubelet            Created container driver-raft-v2beta2
  Normal   Started               2m26s                  kubelet            Started container atomix-broker
  Warning  Unhealthy             2m22s                  kubelet            Startup probe failed: dial tcp 10.244.0.78:5150: connect: connection refused
  Normal   CreatedProxy          2m20s                  atomix             Created proxy to 'onos-consensus-store' for primitive 'onos-e2t-subscriptions'
  Normal   StartingAgent         2m20s                  atomix             Starting agent for store 'onos-consensus-store'
  Normal   StartedAgent          2m20s                  atomix             Started agent for store 'onos-consensus-store'
  Normal   CreatingProxy         2m20s                  atomix             Creating proxy for primitive 'onos-e2t-subscriptions'
  Normal   RegisteringPrimitive  2m20s                  atomix             Registering primitive 'onos-e2t-subscriptions'
  Normal   RegisteredPrimitive   2m20s                  atomix             Registered primitive 'onos-e2t-subscriptions' with broker
  Normal   CreatingProxy         2m20s                  atomix             Creating proxy for primitive 'onos-e2t-channels'
  Normal   CreatedProxy          2m20s                  atomix             Created proxy to 'onos-consensus-store' for primitive 'onos-e2t-channels'
  Normal   RegisteringPrimitive  2m20s                  atomix             Registering primitive 'onos-e2t-channels'
  Normal   RegisteredPrimitive   2m20s                  atomix             Registered primitive 'onos-e2t-channels' with broker
  Normal   Started               2m19s (x2 over 2m27s)  kubelet            Started container onos-e2t
  Normal   Created               2m19s (x2 over 2m27s)  kubelet            Created container onos-e2t
  Normal   Pulled                2m19s (x2 over 2m27s)  kubelet            Container image "onosproject/onos-e2t:v0.10.13" already present on machine
  1. So the probe is trying to connect to the ip of the pod itself and is getting denied:
aviv [ ~ ]$ k get pods onos-e2t-b8cfc66c4-nx5x9 -o wide
NAME                       READY   STATUS             RESTARTS      AGE   IP            NODE                                NOMINATED NODE   READINESS GATES
onos-e2t-b8cfc66c4-nx5x9   2/3     CrashLoopBackOff   7 (69s ago)   12m   10.244.0.78   aks-nodepool1-91329116-vmss000000   <none>           1/1
  1. More specifically, the probe is trying to connect to the onos-et2 container:
onos-e2t:
    Container ID:  containerd://49405c5c2717ca47b1cdadd520a18f449a63ba6af30cdc044dcb3df3796846a7
    Image:         onosproject/onos-e2t:v0.10.13
    Image ID:      docker.io/onosproject/onos-e2t@sha256:44506f7a958d224d65f07b6f8348432ed5395adb8d33b2c4e61406c6aa08ca69
    Ports:         36421/TCP, 5150/TCP
    Host Ports:    0/TCP, 0/TCP
    Args:
      -caPath=/etc/onos/certs/tls.cacrt
      -keyPath=/etc/onos/certs/tls.key
      -certPath=/etc/onos/certs/tls.crt
      -sctpport=36421
      -serviceModel=/usr/local/lib/shared/e2sm_rc_pre_go.so.1.0.0
      -serviceModel=/usr/local/lib/shared/e2sm_kpm_v2_go.so.1.0.0
      -serviceModel=/usr/local/lib/shared/e2sm_mho_go.so.1.0.0
      -serviceModel=/usr/local/lib/shared/e2sm_rsm.so.1.0.0
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Mon, 03 Apr 2023 20:05:30 +0000
      Finished:     Mon, 03 Apr 2023 20:05:31 +0000
    Ready:          False
    Restart Count:  7
    Liveness:       tcp-socket :5150 delay=10s timeout=1s period=10s #success=1 #failure=3
    Readiness:      tcp-socket :5150 delay=10s timeout=1s period=10s #success=1 #failure=3
    Startup:        tcp-socket :5150 delay=0s timeout=1s period=5s #success=1 #failure=60

Logs from the e2t container:

Defaulted container "onos-e2t" out of: onos-e2t, atomix-broker, driver-raft-v2beta2, service-model-e2sm-rc-pre-go-1-0-0 (init), service-model-e2sm-kpm-v2-go-1-0-0 (init), service-model-e2sm-mho-go-1-0-0 (init), service-model-e2sm-rsm-1-0-0 (init)
2023-04-03T20:10:40.916Z        INFO    main    onos-e2t/onos-e2t.go:41 Starting onos-e2t
2023-04-03T20:10:40.916Z        INFO    github.com/onosproject/onos-e2t/pkg/manager     manager/manager.go:49   Creating Manager
2023-04-03T20:10:40.916Z        INFO    github.com/onosproject/onos-e2t/pkg/modelregistry       modelregistry/modelregistry.go:91       Loading module /usr/local/lib/shared/e2sm_rc_pre_go.so.1.0.0
2023-04-03T20:10:40.936Z        INFO    github.com/onosproject/onos-e2t/pkg/modelregistry       modelregistry/modelregistry.go:110      Loaded e2sm_rc_pre v2_go 1.3.6.1.4.1.53148.1.2.2.100 from /usr/local/lib/shared/e2sm_rc_pre_go.so.1.0.0
2023-04-03T20:10:40.936Z        INFO    github.com/onosproject/onos-e2t/pkg/modelregistry       modelregistry/modelregistry.go:91       Loading module /usr/local/lib/shared/e2sm_kpm_v2_go.so.1.0.0
2023-04-03T20:10:40.962Z        INFO    github.com/onosproject/onos-e2t/pkg/modelregistry       modelregistry/modelregistry.go:110      Loaded e2sm_kpm v2_go 1.3.6.1.4.1.53148.1.2.2.2 from /usr/local/lib/shared/e2sm_kpm_v2_go.so.1.0.0
2023-04-03T20:10:40.962Z        INFO    github.com/onosproject/onos-e2t/pkg/modelregistry       modelregistry/modelregistry.go:91       Loading module /usr/local/lib/shared/e2sm_mho_go.so.1.0.0
2023-04-03T20:10:40.988Z        INFO    github.com/onosproject/onos-e2t/pkg/modelregistry       modelregistry/modelregistry.go:110      Loaded e2sm_mho_go v2 1.3.6.1.4.1.53148.1.2.2.101 from /usr/local/lib/shared/e2sm_mho_go.so.1.0.0
2023-04-03T20:10:40.988Z        INFO    github.com/onosproject/onos-e2t/pkg/modelregistry       modelregistry/modelregistry.go:91       Loading module /usr/local/lib/shared/e2sm_rsm.so.1.0.0
2023-04-03T20:10:41.013Z        INFO    github.com/onosproject/onos-e2t/pkg/modelregistry       modelregistry/modelregistry.go:110      Loaded e2sm_rsm v1_go 1.3.6.1.4.1.53148.1.1.2.102 from /usr/local/lib/shared/e2sm_rsm.so.1.0.0
2023-04-03T20:10:41.013Z        INFO    github.com/onosproject/onos-e2t/pkg/manager     manager/manager.go:75   Running Manager
2023-04-03T20:10:41.024Z        INFO    controller      controller/controller.go:158    Activating controller E2T
2023-04-03T20:10:41.024Z        INFO    controller      controller/controller.go:158    Activating controller mastership
2023-04-03T20:10:41.024Z        INFO    controller      controller/controller.go:158    Activating controller Channel
2023-04-03T20:10:41.024Z        INFO    controller      controller/controller.go:158    Activating controller Subscription
2023-04-03T20:10:41.025Z        INFO    controller      controller/controller.go:158    Activating controller configuration
2023-04-03T20:10:41.025Z        INFO    controller      controller/controller.go:158    Activating controller control_relation
2023-04-03T20:10:41.026Z        INFO    github.com/onosproject/onos-e2t/pkg/controller/e2t      e2t/controller.go:109   Reconciling E2T entity with ID: e2:onos-e2t-b8cfc66c4-nx5x9
2023-04-03T20:10:41.033Z        FATAL   github.com/onosproject/onos-e2t/pkg/manager     manager/manager.go:77   Unable to run Managerprotocol not supported
github.com/onosproject/onos-e2t/pkg/manager.(*Manager).Run
        /build/pkg/manager/manager.go:77
main.main
        /build/cmd/onos-e2t/onos-e2t.go:52
runtime.main
        /usr/local/go/src/runtime/proc.go:225

Some protocol is not supported? Please advise.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@avivbd