Skip to main content
Version 3.0

TDP Datacenter 3.0.0

All features, improvements and fixes implemented in TDP Datacenter 3.0.0:

New Components and Features​

  • JupyterLab 4.4.5 — Interactive environment for data analysis, notebooks and visualisations; multi-language and extension support; modern tab-based interface integrating code editing, execution and charts.
  • OpenMetadata 1.9.1 — Data governance and catalogue platform; enables data lineage tracking, data discovery and quality definition; integration with various ecosystem services (databases, lakes, pipelines).

Improvements​

ComponentPrevious VersionCurrent Version
Apache Airflow2.9.32.10.5
Apache Ambari3.0.0.33.0.0.4
Ambari Infra Solr3.0.03.0.0
Ambari Metrics3.1.03.1.0
Apache Atlas2.3.02.3.0
Delta Lake2.3.03.3.0
Apache Druid30.0.032.0.0
Apache Flink1.17.21.17.2
Grafana11.5.211.5.2
Great Expectations1.2.11.3.5
Apache Hadoop3.3.63.3.6
Apache HBase2.5.62.5.7
Apache Hive3.1.34.0.0
Apache Hive LLAP—4.0.0
Apache Hive Metastore3.1.34.0.0
Apache Iceberg1.5.01.8.0
Apache Kafka2.8.23.4.1
Apache Knox2.0.02.0.0
Apache Livy0.8.00.8.0
Apache NiFi1.27.01.28.1
Apache NiFi Registry1.27.01.28.1
Apache Ozone1.4.01.4.1
Apache Phoenix5.2.05.2.0
Apache Ranger2.4.02.4.0
Apache Ranger KMS2.4.02.4.0
Apache Solr8.11.18.11.1
Apache Spark3.3.43.5.3
Apache Sqoop1.4.71.4.7
Apache Superset4.0.24.1.2
Apache Tez0.10.20.10.4
Trino467467
Apache Yarn3.3.63.3.6
Apache Zeppelin0.11.20.11.2
Apache ZooKeeper3.7.23.8.4

Resolved Issues​

New Components:

  • STACK-8616 Added JupyterLab version 4.4.5
  • STACK-8615 Added OpenMetadata version 1.9.1

Updates:

  • BIGTOP-8615 Updated Airflow to version 2.10.5
  • BIGTOP-8615 Updated Atlas to version 2.3.0
  • BIGTOP-8615 Updated Ambari to version 3.0.0.4
  • BIGTOP-8615 Updated Ambari Infra Solr to version 3.0.0.4
  • BIGTOP-8615 Updated Ambari Metrics to version 3.1.0
  • BIGTOP-8615 Updated Delta Lake to version 3.3.0
  • BIGTOP-8615 Updated Druid to version 32.0.0
  • BIGTOP-8615 Updated Flink to version 1.17.2
  • BIGTOP-8615 Updated Grafana to version 11.5.2
  • BIGTOP-8615 Updated Great Expectations to version 1.3.5
  • BIGTOP-8615 Updated Hadoop to version 3.3.6
  • BIGTOP-8615 Updated HBase to version 2.5.7
  • BIGTOP-8615 Updated HDFS to version 3.3.6
  • BIGTOP-8615 Updated Hive to version 4.0.0
  • BIGTOP-8615 Updated Hive LLAP to version 4.0.0
  • BIGTOP-8615 Updated Hive Metastore to version 4.0.0
  • BIGTOP-8615 Updated Iceberg to version 1.8.0
  • BIGTOP-8615 Updated Ambari Infra Solr to version 3.0.0
  • BIGTOP-8615 Updated Kafka to version 3.4.1
  • BIGTOP-8615 Updated Kerberos to version 1.10.3-30
  • BIGTOP-8615 Updated Knox to version 2.0.0
  • BIGTOP-8615 Updated Livy to version 0.8.0
  • BIGTOP-8615 Updated NiFi to version 1.28.1
  • BIGTOP-8615 Updated NiFi Registry to version 1.28.1
  • BIGTOP-8615 Updated Ozone to version 1.4.1
  • BIGTOP-8615 Updated Phoenix to version 5.2.0
  • BIGTOP-8615 Updated Ranger to version 2.4.0
  • BIGTOP-8615 Updated Ranger KMS to version 2.4.0
  • BIGTOP-8615 Updated Solr to version 8.11.1
  • BIGTOP-8615 Updated Sqoop to version 1.4.7 (deprecated component — scheduled for removal in TDP 3.1.0)
  • BIGTOP-8615 Updated Spark to version 3.5.3
  • BIGTOP-8615 Updated Superset to version 4.1.2
  • BIGTOP-8615 Updated Tez to version 0.10.4
  • BIGTOP-8615 Updated Trino to version 467
  • BIGTOP-8615 Updated Yarn to version 3.3.6
  • BIGTOP-8615 Updated Zeppelin to version 0.11.2
  • BIGTOP-8615 Updated ZooKeeper to version 3.8.4

Bug Fixes:

  • STACK-8897 Boolean property (props) parsing in Airflow
  • BIGTOP-8573 CLI issues in standard Airflow installation
  • AMBARI-6468 Namenode failure when identifying underscores in hostname
  • AMBARI-9530 Ambari build failure via Jenkins (Files View)
  • STACK-9346 Certificate type error in Ambari Infra Solr with SSL enabled
  • BIGTOP-9560 Error in Ambari after-INSTALL script when configuring Atlas Server version
  • BIGTOP-9156 Failure in 'import-hive' script
  • STACK-8282 Error saving to Iceberg using Stream on partitioned table
  • AMBARI-METRICS-9218 Error in KafkaTimelineMetricsReporter in Ambari Metrics
  • STACK-8724 New log standard (Log4j2) in Knox
  • BIGTOP-9549 Livy session initialisation error
  • TDP-PATCHES-9290 Error writing OFS protocol in Ozone
  • STACK-9155 HTTPS operation for Solr (Keystores and Truststores configuration)
  • STACK-6314 Syntax error in Superset DEFAULT_FEATURE_FLAGS parameter when loading superset_config.py
  • BIGTOP-8884 Trino installation error due to required Python already installed
  • STACK-5655 Filesystem Closed exception on YARN RM startup
  • AMBARI-9529 Missing postgresql14-contrib library on metadata server

Improvements:

  • AMBARI-9312 Grafana and Ambari Metrics upgrade
  • STACK-8458 HBase Thrift Server as a service
  • STACK-8615 Rolling and Express Upgrade for TDP 3.0.0