OpenMLDB released a new version v0.8.5, including SQL syntax extensions, Iceberg data lake support, TTL type extensions, and improved user authentication functionality. The most noteworthy feature is the integration of the Iceberg engine and the enhancement of user authentication.

file

Iceberg is an open-source table format data lake management tool, focusing on providing a highly reliable, scalable data lake management solution. Its core features include atomic write mechanisms, multi-version data management, metadata management, etc., aiming to provide comprehensive data lake management functionality for enterprises. OpenMLDB integrates Iceberg into its platform, allowing users to directly read and write Iceberg data lakes while using OpenMLDB's features. This results in higher data reliability and consistency, more flexible data operations and management, and more efficient data query performance, providing enterprises with a comprehensive and reliable data lake management solution.

OpenMLDB has also introduced user authentication functionality, allowing users to more flexibly manage and control database access permissions through SQL statements such as CREATE / ALTER / DROP USER. This feature not only ensures the security of the data but also enhances the convenience and flexibility of database management. Users can autonomously manage the creation, modification, and deletion of user accounts according to their actual needs, better meeting the enterprise's requirements for data access permission management, and improving the overall system's security and manageability.

For detailed release notes, please refer to: https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.5 Please feel free to download and explore the latest release. Your feedback is highly valued and appreciated. We encourage you to share your thoughts and suggestions to help us improve and enhance the platform. Thank you for your support!

Release Date

28 February 2024

Release Notes

https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.5

Highlights

  • Added integration with Apache Iceberg offline storage engine, supporting data import and feature data export functionalities, further strengthening the integration of OpenMLDB with the ecosystem.
  • Added standard SQL syntax UNION ALL, expanding WINDOW UNION and LAST JOIN to achieve multi-table join.
  • Support for SELECT INTO OUTFILE to configure OpenMLDB online tables, achieving synchronization between online and offline storage.
  • In offline mode, LAST JOIN and WINDOW operations support not specifying ORDER BY parameters, making usage more flexible.
  • Added user management functionality, enabling user addition, modification, and deletion through standard SQL statements CREATE / ALTER / DROP USER.
  • Support for configuring Spark task parameters through SDK, providing more flexible offline task resource configuration.
  • INSERT statement supports configuring server-side memory limits, providing more user-friendly error messages for insertion failures.
  • LEFT JOIN statement deployment supports automatic index creation, eliminating the need for manual index creation and data re-importation.
  • File storage engine supports TTL types absandlat / absorlat, aligning with in-memory storage engine functionality.

Short post: OpenMLDB released a new version v0.8.5, including SQL syntax extensions, Iceberg data lake support, TTL type extensions, and improved user authentication functionality. For detailed release notes, please refer to the release note at: https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.5 and highlights at https://openmldb.medium.com/openmldb-v0-8-5-b70b45e51733. Please feel free to download and explore the latest release. Your feedback is highly valued and appreciated!

For more information on OpenMLDB: