Researchers from Amazon Web Services (AWS) have launched the new SQL-compatible query language PartiQL. This makes it possible to query data efficiently, regardless of location or format.
The query language should make it possible to process structured data from relational databases, writes Analytics India Magazine. PartiSQL promises to have more features than SQL, one of the oldest players in data management. This language also made it possible to work with large amounts of data.
The problem is that data – both structured and unstructured – is stored in multiple databases and data lakes. In addition, data analysts with SQL do not have complete control over the databases. This causes problems between the query language and the data format in which it is stored.
Generation of PartiQL
The researchers at AWS want to solve these problems with PartiQL. The main reason the researchers introduce the language is because they encounter challenges in transforming SQL table data and semi-structured data found in different formats and storage engines.
The Amazon researchers not only wanted to use SQL, but also to extend access to the non-relational data of the data lake, while maintaining strict backward compatibility with SQL.
Thus, PartiQL maintains compatibility with SQL, which means that SQL queries continue to work in the SQL query processors that are expanded to support PartiQL. This makes it easier for developers to use the new language.
The language is designed to be used for database engines that expect the presence of a schema, but also for database engines that work without a schema.
PartiQL is also independent of any data format. For example, a query can be written in JSON, Parquet, ORC or CSV. The language is also independent of an underlying data store. In addition, it meets the requirements of NoSQL.This news article was automatically translated from Dutch to give Techzine.eu a head start. All news articles after September 1, 2019 are written in native English and NOT translated. All our background stories are written in native English as well. For more information read our launch article.