Logo

Databricks and Informatica partner

Databricks and Informatica have formed a partnership to accelerate the development of intelligent data pipelines. As a result of the partnership, the companies introduced product integrations that provide rapid and efficient data ingestion, simplified creation of high-volume data pipelines, and integrated data governance for intelligent data discovery and end-to-end lineage. The partnership is being announced on the keynote stage by CEOs Ali Ghodsi and Anil Chakravarthy at Informatica World 2019, taking place now in Las Vegas.

  • 5 years ago Posted in
Today data engineering and data science teams depend on many hybrid data sources that make finding the right datasets and tracing the lineage of data through pipeline processing impossible. Bringing the Informatica capabilities for discovery, lineage, ingestion and preparation together with Databricks’ Unified Analytics Platform provides an analytics solution for intelligent data pipelines that leverages the correct datasets and provides end-to-end data lineage for analytics and machine learning implementations.

 

The Informatica and Databricks partnership introduces product integrations that allow faster development and complete governance for data engineering workloads:

  • Informatica’s Cloud Data Integration and Databricks’ Unified Analytics Platform enable data teams to quickly ingest data directly into a managed data lake from hundreds of hybrid data sources.
  • Informatica’s Big Data Management with Databricks’ Unified Analytics Platform allows data teams to easily create performant, scalable data pipelines for big data. Using Informatica’s visual drag and drop workflows, data teams can define their data pipelines to run on highly optimized Apache Spark™ clusters in Databricks to provide high performance at scale.
  • Informatica’s Enterprise Data Catalog provides support for tracking data lineage of pipelines with Databricks’ Unified Analytics Platform, and makes Databricks tables available as part of the data catalog.

 

Informatica is also announcing support for Delta Lake, the new open source project from Databricks, to provide an analytics-ready place to store massive amounts of data. Delta Lake provides ACID transactions and schema enforcement that brings reliability at scale to data lakes and makes high quality datasets ready for downstream analytics.

DocuWare Introduces Intelligent Document Processing (DocuWare IDP)

Beacon, NY, Dec 20, 2024– DocuWare unveils its AI-powered Intelligent Document Processing...

UK data concerns soar as AI surges

Hitachi Vantara survey finds data demands to triple by 2026, highlighting critical role of data...

Half of executives feel overwhelmed by the sheer volume of data and dashboards they receive daily

Only 45% of business data is fully utilised in decision-making, while 34% of business leaders state...

Data quality a major barrier to AI success

Hitachi Vantara survey finds data demands to triple by 2026, highlighting critical role of data...

Yamaha Corporation harnesses Informatica's AI-powered Master Data Management

Yamaha Corporation, a world-renowned leader in musical instrument manufacturing, has chosen to...

Panzura and GRAU DATA partnership 'transforms' data management

Panzura and GRAU DATA have formed a partnership and introduced an integrated solution that...

72% of data leaders fear failure to adopt AI will result in competitive disadvantage

77% cite increasing operational efficiency as the main strategic and spending priority for 2025.

Organizations’ lack of data poses major challenge to decarbonization

Availability and access to right data is key challenge to decarbonization efforts, despite 54% of...

© 2024 - Angel Business Communications Limited

Made with by Angels