BigData

Apache Atlas to Airflow

Kyle79 2020. 5. 25. 09:50

 

 

https://airflow.apache.org/docs/stable/lineage.html

 

Lineage — Airflow Documentation

 

airflow.apache.org

 

 

https://pypi.org/project/atlasclient/

 

atlasclient

Apache Atlas client

pypi.org

 

 

from atlasclient.client import Atlas
client = Atlas('xxx.xxx.xxx.xxx', port=21000, username='admin', password='admin')
# client.entity_guid(<guid>).status
params = {'typeName': 'DB', 'attrName': 'name', 'attrValue': 'Logging', 'offset': '1', 'limit':'10'}
search_results = client.search_attribute(**params)
for s in search_results:
    for e in s.entities:
         print(e.name)
         print(e.guid)