Support Multiple Platfrom Instances
“Hi All, would it be possible to add “cluster” property in Airflow datahub provider? Right now it’s not present and thus defaults to “prod””: (Original Slack post)
“I'm wondering why https://github.com/linkedin/datahub/blob/master/li-utils/src/main/pegasus/com/linkedin/common/FabricType.pdl has only pre-defined set of values. We would like to split our hierarchy of objects in UI based on GEO locations like NA, EMEA, AP etc., but looks like the only option is to have {FabricType}/{data source type}/{database name} and there is no flexibility for custom value on any of these layers.” - Original Slack post
“the bigger "problem" is we have multiple Snowflake instances and MySQL clusters so the current datasetUrn isn't able to uniquely identify datasets. e.g. this URN clashes in different Snowflake instances urn:li:dataPlatform:snowflake,db.schema.table,PROD
. If we can somehow include the instance/cluster information then that would work for Snowflake + MySQL.” - Original Slack post
Subscribe to post
Get notified by email when there are changes.