BigData

K8s Volume 및 PV/PVC 및 S3 볼륨 설정, gitRepo, StatefulSet

Kyle79 2020. 5. 28. 14:33
apiVersion: v1
kind: Secret
metadata:
  name: s3
  namespace: digdag-jobs
type: Opaque
stringData:
    id: ******************
    secret: ************************************
---
apiVersion: v1
kind: Pod
metadata:
  name: example
  namespace: digdag-jobs
spec:
  restartPolicy: Never
  imagePullSecrets:
    - name: dockercfg
  volumes:
  - name: s3-mount
    emptyDir: {}

  containers:
  - name: nginx-container
    image: nginx
    volumeMounts:
    - mountPath: /data:slave
      name: s3-mount
      mountPropagation: Bidirectional      

  - name: goofys
    env:
    - name: MOUNT_DIR
      value: /vortex-artifacts
    - name: BUCKET
      value: eg-example-data
    - name: REGION
      value: us-west-2
    - name: DIR_MODE
      value: "0777"
    - name: FILE_MODE
      value: "0777"
    - name: AWS_ACCESS_KEY_ID
      valueFrom:
        secretKeyRef:
          name: s3
          key: id
    - name: AWS_SECRET_ACCESS_KEY
      valueFrom:
        secretKeyRef: 
          name: s3
          key: secret
    image: cloudposse/goofys
    imagePullPolicy: Always
    resources: {}
    securityContext:
      privileged: true
      runAsUser: 0
    terminationMessagePath: /dev/termination-log
    terminationMessagePolicy: File
    volumeMounts:
    - mountPath: /data:shared
      name: s3-mount
      mountPropagation: Bidirectional

 

https://kubernetes.io/ko/docs/concepts/storage/persistent-volumes/

 

퍼시스턴트 볼륨

 

kubernetes.io

 

 

 

https://icicimov.github.io/blog/virtualization/Kubernetes-shared-storage-with-S3-backend/

 

Kubernetes shared storage with S3 backend

There are many options available in Kubernetes when it comes to shared storage. I’m using a S3 bucket as backend for the shared storage in a k8s cluster in AWS.

icicimov.github.io

 

 

 

https://bcho.tistory.com/1259

 

쿠버네티스 #5 - 디스크 (볼륨/Volume)

쿠버네티스 #4 Volume (디스크) 조대협 (http://bcho.tistory.com) 이번 글에서는 쿠버네티스의 디스크 서비스인 볼륨에 대해서 알아보도록 하겠다. 쿠버네티스에서 볼륨이란 Pod에 종속되는 디스크이다. (

bcho.tistory.com

 

 

** StatefulSet을 이용한 상태유지 Pod Volume 관리하기

https://bcho.tistory.com/1306

 

쿠버네티스 #22 - StatefulSet을 이용한 상태유지 Pod (데이타베이스) 관리하기 1/2

StatefulSet을 이용하여 상태가 유지되는 Pod 관리하기 조대협 (http://bcho.tistory.com) ReplicaSet으로 Stateful Pod 관리하기 앞에서 쿠버네티스의 Pod를 관리하기 위한 여러가지 컨트롤러 (Replica Set, Repl..

bcho.tistory.com

 

 

https://kubernetes.io/ko/docs/tasks/access-application-cluster/communicate-containers-same-pod-shared-volume/

 

공유 볼륨을 이용하여 동일한 파드의 컨테이너 간에 통신하기

 

kubernetes.io

 

 

 

https://www.ibm.com/support/knowledgecenter/ko/SSBS6K_3.1.0/manage_images/imagepullsecret.html

 

IBM Knowledge Center

Please note that DISQUS operates this forum. When you sign in to comment, IBM will provide your email, first name and last name to DISQUS. That information, along with your comments, will be governed by DISQUS’ privacy policy. By commenting, you are acce

www.ibm.com

 

 

 

https://github.com/cloudposse/goofys

 

cloudposse/goofys

Goofys S3 Filesystem Docker Implementation. Contribute to cloudposse/goofys development by creating an account on GitHub.

github.com

 

 

 

 

 

 

 

 

'BigData' 카테고리의 다른 글

create DB in postgres 및 size check  (0) 2020.06.01
k8s API LIST RETRIEVE  (0) 2020.05.29
K8S 클러스터 내부 DNS 주소를 확인  (0) 2020.05.28
Kubernetes jobs  (0) 2020.05.27
Apache Atlas to Airflow  (0) 2020.05.25