Fivetran Introduces Metadata API, Enables End-to-End Data Analytics and Visibility

OAKLAND, Calif., September 20, 2022 – Fivetran today announced the availability of its Metadata API to enable “in-flight” tracking of data from source to destination as it travels through Fivetran-managed pipelines. With this added visibility, customers can integrate governance and observability tools to give data teams more control over who has access to what data. Enabling automated data governance, the Fivetran Metadata API also provides data managers, security teams, and data engineering teams with the visibility needed to know where the data came from, who accessed it, and what changes. occurred in the pipeline.

“Every business knows they need to be data-driven, but traditional data governance has been a barrier with manual processes and reactive policy enforcement. It’s not a scalable approach, especially since data infrastructure turns into thousands of pipelines,” said Fraser Harris, VP of Product at Fivetran. “With the Metadata API, our customers benefit from data governance and workflow automations from out-of-the-box data quality so they can proactively identify and act on governance issues before they become a problem. Our automated in-flight approach enables large-scale data access without increasing business risk. »

Complex laws such as the European GDPR, the California Consumer Privacy Act (CCPA) and other state laws impose fines on companies that do not follow complex rules to protect data privacy. The Fivetran Metadata API helps companies meet compliance requirements, easily integrating into their existing privacy and security strategies while enhancing the value of investments they have made in data catalogs and data management solutions. data quality.

With the Fivetran Metadata API:

  • Data analysts have a deep understanding of the origin of the data and are able to perform impact analysis on it.
  • Data stewards know that end users have access to data that has been securely processed and meets governance requirements.
  • Security and legal teams can perform security audits and ensure that the data being moved complies with organizational policies.
  • Data architects and engineers will soon be able to understand upstream schema changes and ensure downstream processes are kept up to date.

Creating an Automated Data Governance Experience – Fivetran Partners with Major Data Catalogs

Fivetran is excited to launch better metadata management with four leading data catalog providers: Atlan, data.world, Alation and Collibra. Here are the combined benefits:

  • Information about all data can be consolidated into a single data catalog, for a complete view and a seamless user experience.
  • End-to-end data lineage charts are available for data, even if the data flows through multiple systems and tools.
  • By centralizing governance in a single tool, data stewards can better ensure that policies and processes are applied to data when needed.
  • The ability to source column-level trace data back to its origin helps confirm data quality and builds confidence in data accuracy and safety of use.

“Fivetran’s Metadata API solves a major gap in extracting data from operational systems to modern analytical systems by providing the much-needed context. The availability of the Metadata API will accelerate the development of reliable and secure applications at data-intensive by exposing aspects of lineage, impact analysis, security and privacy,” said Sanjeev Mohan, Director of SanjMo, data and analytics expert and former research vice president at Gartner.

“Our customers are excited to go faster with more visibility, powered by metadata from Fivetran,” said Prukalpa Sankar, co-founder of Atlan. “No more manually assembling sources. With the new Metadata API, customers can now import metadata from Fivetran into Atlan for a truly automated data governance experience. This end-to-end lineage covers everything from upstream sources to the warehouse and BI layer, helping customers stay informed on complex data stacks with powerful root cause and impact analysis.

“data.world’s interface with Fivetran enables data producers and consumers to understand and trust the synchronization and mapping of data across all important business databases, data sources and applications” , said Jon Loyens, CPO and co-founder of data.world. “Working with Fivetran, we provide granular data visibility, including source-destination column pair metadata, simplifying data discovery, data governance, and actionable insights.”

A new report published by Vanson Bourne for Fivetran highlights that companies continue to struggle with good data governance – a necessity for compliance. All (100%) of US respondents said their company could improve data governance roles, policies and standards, 90% of respondents in France, 82% of respondents in the UK and Ireland, and 82% of respondents in Germany saying the same. .

About Fivetran

Fivetran is the world leader in modern data integration. Our mission is to make access to data as easy and reliable as electricity. Built for the cloud, Fivetran enables data teams to centralize and effortlessly transform data from hundreds of SaaS and on-premises data sources into high-performance cloud destinations. Fast-moving startups from the world’s largest enterprises use Fivetran to accelerate modern analytics and operational efficiency, fueling data-driven business growth. Fivetran is headquartered in Oakland, California, and has offices around the world.


Source: Fivetran