More Information — TDP Datacenter
Additional information about the components of the TDP Datacenter edition in version 3.0.0.
Updated Components
The table below shows the components that were updated in this version of TDP Datacenter:
| Component | Previous Version | Current Version |
|---|---|---|
| Apache Airflow | 2.9.3 | 2.10.5 |
| Apache Ambari | 3.0.0.3 | 3.0.0.4 |
| Delta Lake | 2.3.0 | 3.3.0 |
| Apache Druid | 30.0.0 | 32.0.0 |
| Great Expectations | 1.2.1 | 1.3.5 |
| Apache HBase | 2.5.6 | 2.5.7 |
| Apache Hive | 3.1.3 | 4.0.0 |
| Apache Iceberg | 1.5.0 | 1.8.0 |
| Apache Kafka | 2.8.2 | 3.4.1 |
| Apache NiFi | 1.27.0 | 1.28.1 |
| Apache Spark | 3.3.4 | 3.5.3 |
| Apache Superset | 4.0.2 | 4.1.2 |
| Apache Tez | 0.10.2 | 0.10.4 |
| Apache Zookeeper | 3.7.2 | 3.8.4 |
Datacenter Edition Characteristics
The TDP Datacenter edition is intended for deployment in on-premises datacenters, using:
- Apache Ambari for cluster management and monitoring
- Deployment on bare-metal or virtual machines
- Operating systems: CentOS, Red Hat, Rocky Linux, AlmaLinux (8.x and 9.x)
- x86-64 architecture
For the full component matrix, see the TDP Datacenter Components page.
Issue Summary — TDP Datacenter 3.0.0
Below are the issues resolved in this version:
New Components:
- STACK-8616 Addition of JupyterLab version 4.4.5
- STACK-8615 Addition of OpenMetadata version 1.9.1
Updates:
- BIGTOP-8615 Update of Airflow to version 2.10.5
- BIGTOP-8615 Update of Atlas to version 2.3.0
- BIGTOP-8615 Update of Ambari to version 3.0.0.4
- BIGTOP-8615 Update of Ambari Infra Solr to version 3.0.0.4
- BIGTOP-8615 Update of Ambari Metrics to version 3.1.0
- BIGTOP-8615 Update of Delta Lake to version 3.3.0
- BIGTOP-8615 Update of Druid to version 32.0.0
- BIGTOP-8615 Update of Flink to version 1.17.2
- BIGTOP-8615 Update of Grafana to version 11.5.2
- BIGTOP-8615 Update of Great Expectations to version 1.3.5
- BIGTOP-8615 Update of Hadoop to version 3.3.6
- BIGTOP-8615 Update of HBase to version 2.5.7
- BIGTOP-8615 Update of HDFS to version 3.3.6
- BIGTOP-8615 Update of Hive to version 4.0.0
- BIGTOP-8615 Update of Hive LLAP to version 4.0.0
- BIGTOP-8615 Update of Hive Metastore to version 4.0.0
- BIGTOP-8615 Update of Iceberg to version 1.8.0
- BIGTOP-8615 Update of infra Solr to version 3.0.0
- BIGTOP-8615 Update of KafKa to version 3.4.1
- BIGTOP-8615 Update of Kerberos to version 1.10.3-30
- BIGTOP-8615 Update of Knox to version 2.0.0
- BIGTOP-8615 Update of Livy to version 0.8.0
- BIGTOP-8615 Update of NiFi to version 1.28.1
- BIGTOP-8615 Update of NiFi Registry to version 1.28.1
- BIGTOP-8615 Update of Ozone to version 1.4.1
- BIGTOP-8615 Update of Phoenix to version 5.2.0
- BIGTOP-8615 Update of Ranger to version 2.4.0
- BIGTOP-8615 Update of Ranger KMS to version 2.4.0
- BIGTOP-8615 Update of Solr to version 8.11.1
- BIGTOP-8615 Update of Sqoop to version 1.4.7 (deprecated component — see note)
- BIGTOP-8615 Update of Spark to version 3.5.3
- BIGTOP-8615 Update of Superset to version 4.1.2
- BIGTOP-8615 Update of Tez to version 0.10.4
- BIGTOP-8615 Update of Trino to version 467
- BIGTOP-8615 Update of Yarn to version 3.3.6
- BIGTOP-8615 Update of Zeppelin to version 0.11.2
- BIGTOP-8615 Update of ZooKeeper to version 3.8.4
Fixes:
- STACK-8897 Interpretation of boolean properties (props) in Airflow
- BIGTOP-8573 Issue with CLIs in the default Airflow installation
- AMBARI-6468 Namenode failure when identifying underscore in hostname
- AMBARI-9530 Ambari build failure via Jenkins (Files View)
- STACK-9346 Error related to certificate type in Ambari Infra Solr with SSL enabled
- BIGTOP-9560 Error in the Ambari post-install script (after-INSTALL) when trying to configure the Atlas Server version
- BIGTOP-9156 Failure in the 'import-hive' script
- STACK-8282 Error saving to Iceberg using Stream on a partitioned table
- AMBARI-METRICS-9218 Error in the KafkaTimelineMetricsReporter method present in Ambari Metrics
- STACK-8724 New logging standard (Log4j2) in Knox
- BIGTOP-9549 Error initializing the Livy session
- TDP-PATCHES-9290 Error writing OFS protocol in Ozone
- STACK-9155 Solr operation over HTTPS (Keystore and Truststore configuration)
- STACK-6314 Syntax error in the Superset DEFAULT_FEATURE_FLAGS parameter when loading superset_config.py
- BIGTOP-8884 Error installing Trino due to a Python requirement already installed
- STACK-5655 Filesystem Closed exception when starting the YARN RM
- AMBARI-9529 Missing postgresql14-contrib library on the metadata server
Improvements:
- AMBARI-9312 Upgrade of Grafana and Ambari Metrics
- STACK-8458 HBase Thrift Server as a service
- STACK-8615 Rolling and Express Upgrade for TDP 3.0.0
Upstream Documentation and Communities
Links to the release notes, Jira, and repositories of the projects that make up TDP Datacenter.
Apache Airflow 2.10.5
Apache Ambari 3.0.0.4
Apache Atlas 2.3.0
Delta Lake 3.3.0
Apache Druid 32.0.0
Apache Flink 1.17.2
Grafana 11.5.2
Great Expectations 1.3.5
Apache Hadoop 3.3.6
Apache HBase 2.5.7
Apache Hive 4.0.0
Apache Iceberg 1.8.0
JupyterLab 4.4.5
Apache Kafka 3.4.1
Apache Kerberos 1.10.3-30
Apache Knox 2.0.0
Apache Livy 0.8.0
Apache NiFi 1.28.1
OpenMetadata 1.9.1
Apache Ozone 1.4.1
Apache Phoenix 5.2.0
Apache Ranger 2.4.0
Apache Solr 8.11.1
Apache Spark 3.5.3
Apache Sqoop 1.4.7
Deprecated component — removal planned for TDP 3.1.0
Apache Sqoop has been retired by the Apache Software Foundation and moved to the Apache Attic. It no longer receives updates, security fixes, or community support. The latest stable version is 1.4.7 (2017). Starting with TDP 3.1.0, this component will be removed from the platform.