Uploaded image for project: 'Acumos'
  1. Acumos
  2. ACUMOS-3929

Deploy a composite model - not able to deploy easily (without admin) help and multiple pain points

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Priority: Medium
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      When using composite model following soup to nuts example. I was using the new deploy to kubernetes (without the local download step) and the deployment is failing in jenkins.

       There are two issues

      1. Save button doesn't generate blue print for composite model.. only the verify button does that. 
      2. Once you have blue print file aka click on verify button in acu-compose then you can deploy but job ends with error

       

      When there is no Blueprint file error:

      Started by user unknown or anonymous Running as SYSTEM Building in workspace /var/jenkins_home/workspace/solution-deploy [solution-deploy] $ /bin/bash /tmp/jenkins6221837448389383262.sh + trap fail ERR + rm -rf deploy solution.zip + DEPLOYMENT_CLIENT=http://deployment-client-service:8337 + curl -o solution.zip http://deployment-client-service:8337/getSolutionZip/48/ % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 151 0 151 0 0 264 0 --:--:-- --:--:-- --:--:-- 264 + unzip solution.zip -d deploy Archive: solution.zip End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. unzip: cannot find zipfile directory in one of solution.zip or solution.zip.zip, and cannot find solution.zip.ZIP, period. ++ fail ++ [[ ! -e status.json ]] ++ cat ++ cat status.json {"status": "FA", "reason": "Unknown failure in Jenkins deployment task", "ingress": ""} ++ curl -X POST -H Content-Type:application/json http://deployment-client-service:8337/status/48 -d @status.json % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 102 100 15 100 87 27 160 --:--:-- --:--:-- --:--:-- 159 100 102 100 15 100 87 27 159 --:--:-- --:--:-- --:--:-- 159 {"status":"OK"}++ exit 1 Build step 'Execute shell' marked build as failure Finished: FAILURE
      

       

      Jenkins log when blue print file is created and attempting to deploy but fails 

       

      ++ date
      + echo 'fail:48 (Fri Jan 17 16:29:08 UTC 2020) face-detect1-200117-153820-5647fc968c-8kmjb did not start successfully after 5 minutes'
      fail:48 (Fri Jan 17 16:29:08 UTC 2020) face-detect1-200117-153820-5647fc968c-8kmjb did not start successfully after 5 minutes
      + exit 1
      ++ fail
      ++ [[ ! -e status.json ]]
      ++ cat status.json
      {"status": "FA", "reason": "face-detect1-200117-153820-5647fc968c-8kmjb did not start successfully after 5 minutes", "ingress": "not available (failed)"}
      ++ curl -X POST -H Content-Type:application/json http://deployment-client-service:8337/status/49 -d @status.json
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                       Dload  Upload   Total   Spent    Left  Speed
      
        0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
      100   168  100    15  100   153     27    278 --:--:-- --:--:-- --:--:--   279
      {"status":"OK"}++ exit 1
      Build step 'Execute shell' marked build as failure
      Finished: FAILURE

       

      When I run kubectl command to get status of pod

      acumos@acumos-bionic-4:~$ kubectl describe pod/face-detect1-200117-153820-5647fc968c-8kmjb -n acumos-models
      Name:               face-detect1-200117-153820-5647fc968c-8kmjb
      Namespace:          acumos-models
      Priority:           0
      PriorityClassName:  <none>
      Node:               acumos-bionic-4/10.1.0.30
      Start Time:         Fri, 17 Jan 2020 15:38:21 +0000
      Labels:             app=face-detect1-200117-153820
                          pod-template-hash=5647fc968c
                          trackingid=200117-153820
      Annotations:        cni.projectcalico.org/podIP: 192.168.0.132/32
      Status:             Pending
      IP:                 192.168.0.132
      Controlled By:      ReplicaSet/face-detect1-200117-153820-5647fc968c
      Containers:
        face-detect1-200117-153820:
          Container ID:
          Image:          acumos-bionic-1:32493/face_privacy_filter_detect_a28f068f-45a1-4d93-801a-6e2a71568e91:1.0.1
          Image ID:
          Port:           3330/TCP
          Host Port:      0/TCP
          State:          Waiting
            Reason:       ImagePullBackOff
          Ready:          False
          Restart Count:  0
          Environment:    <none>
          Mounts:
            /var/run/secrets/kubernetes.io/serviceaccount from default-token-6mww7 (ro)
      Conditions:
        Type              Status
        Initialized       True
        Ready             False
        ContainersReady   False
        PodScheduled      True
      Volumes:
        default-token-6mww7:
          Type:        Secret (a volume populated by a Secret)
          SecretName:  default-token-6mww7
          Optional:    false
      QoS Class:       BestEffort
      Node-Selectors:  <none>
      Tolerations:     node.kubernetes.io/not-ready:NoExecute for 300s
                       node.kubernetes.io/unreachable:NoExecute for 300s
      Events:
        Type     Reason   Age                    From                      Message
        ----     ------   ----                   ----                      -------
        Normal   Pulling  15m (x43 over 3h30m)   kubelet, acumos-bionic-4  pulling image "acumos-bionic-1:32493/face_privacy_filter_detect_a28f068f-45a1-4d93-801a-6e2a71568e91:1.0.1"
        Warning  Failed   10m (x875 over 3h30m)  kubelet, acumos-bionic-4  Error: ImagePullBackOff
        Normal   BackOff  9s (x919 over 3h30m)   kubelet, acumos-bionic-4  Back-off pulling image "acumos-bionic-1:32493/face_privacy_filter_detect_a28f068f-45a1-4d93-801a-6e2a71568e91:1.0.1"

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            justin14 Justin Early
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated: