Talend, the data integration provider, is enhancing security by improving the self-service features and adding support for the latest release of the Apache Spark analytics framework in a new version of its Talend Data Fabric.
Talend can now integrate natively with Spark 3.0, which was released just over 12 months ago.
Among the measures taken to tighten security, we find performance improvements driven by adaptive query execution and dynamic partition pruning, compliance with ANSI SQL, and improvements in the APIs to pandas, a widely used open-source data science and analysis package.
Improving end-user experiences
The new Talend release is compatible with Spark implementations from Databricks and Amazon Web Services’ Elastic MapReduce 6.2.
Thomas Steinborn, the Veep of Product at Talend, said that Spark avails “new primitives to integrate at scale,” meaning users can integrate the most performant code to gain more insights from the data collected.
Talend is also introducing a self-service portal where users can find a central listing of all application programming interfaces and documentation, to make it easier for users to discover resources and for developers to share APIs, documentation, and data structure across a team.
Privacy enhanced
Steinborn said that the company’s focus on self-service is about enabling everyone to participate in data governance. He added that the release is providing end-users with the right user experience, ensuring operations are repeatable, and making the data integration pipeline operational.
Talend also said that this latest iteration is the first data integration provider to support private connectivity between its platform and AWS or Azure instances using a private link, which is more secure than a virtual private network.
Instead of opening up the entire network and exposing the company using VPNs, private links focus on one endpoint.
2 hours ago
