BigData

Apache Atlas to Airflow

Kyle79 2020. 5. 25. 09:50

 

 

https://airflow.apache.org/docs/stable/lineage.html

 

Lineage — Airflow Documentation

 

airflow.apache.org

 

 

https://pypi.org/project/atlasclient/

 

atlasclient

Apache Atlas client

pypi.org

 

 

from atlasclient.client import Atlas
client = Atlas('xxx.xxx.xxx.xxx', port=21000, username='admin', password='admin')
# client.entity_guid(<guid>).status
params = {'typeName': 'DB', 'attrName': 'name', 'attrValue': 'Logging', 'offset': '1', 'limit':'10'}
search_results = client.search_attribute(**params)
for s in search_results:
    for e in s.entities:
         print(e.name)
         print(e.guid)

'BigData' 카테고리의 다른 글

K8S 클러스터 내부 DNS 주소를 확인  (0) 2020.05.28
Kubernetes jobs  (0) 2020.05.27
bigquery to storage backup  (0) 2020.05.20
digdag  (0) 2020.05.20
Apache beam  (0) 2020.05.19