Skip to main content
Version 3.0

About TDP Kubernetes​

TDP Kubernetes is the cloud-native edition of the Tecnisys Data Platform, designed for deployments on Kubernetes clusters. This edition uses Helm Charts for packaging and ArgoCD for GitOps, offering:

  • Declarative implementation via Helm Charts
  • Automated GitOps with ArgoCD
  • Elastic resource scalability
  • Native integration with Kubernetes ecosystem
  • Simplified configuration management
  • Support for multiple environments (development, approval, production, etc.)

The deployment of the TDP-K8s is modular and flexible. It orchestrates several essential components for the data lifecycle:

  • Distributed processing: Apache Spark and Trino.
  • Streaming and ingestion: Apache Kafka (Strimzi) and Apache NiFi.
  • Storage and metadata: Hive Metastore, PostgreSQL (metadata database) and Apache Iceberg.
  • Orchestration: Apache Airflow.
  • Analytical storage: ClickHouse.
  • Object storage: Apache Ozone.
  • Governance and security: OpenMetadata and Apache Ranger.
  • Visualization and BI: Apache Superset.
  • Interface and administration: JupyterHub and CloudBeaver.
Figure — General architecture of TDP Kubernetes. Helm Charts and Docker images are stored in the Artifact Registry; TDPCTL or ArgoCD applies configurations to the cluster; data persists on external storage; components are accessed via API Gateway.
Figure — General architecture of TDP Kubernetes. Helm Charts and Docker images are stored in the Artifact Registry; TDPCTL or ArgoCD applies configurations to the cluster; data persists on external storage; components are accessed via API Gateway.

Cloud-Native Architecture​

TDP Kubernetes adopts a microservices architecture, where each component of the Big Data ecosystem runs in containers managed by Kubernetes. Helm Charts encapsulate all deployment complexity, while ArgoCD ensures continuous synchronization between the desired state (Git) and the actual state of the cluster.

New Components​

This edition includes components exclusive to Kubernetes:

  • ClickHouse: High performance columnar OLAP database
  • CloudBeaver: Web interface for database administration
  • Kubernetes: Container orchestration and workload management

Use Cases​

This edition is ideal for:

  • Public cloud deployments (AWS, GCP and Azure)
  • On-premise Kubernetes environments
  • Cloud-native and microservices architectures
  • Organizations that adopt DevOps and GitOps practices
  • Workloads that require dynamic scalability
  • Multi-tenant environments

Helm Chart Registry​

TDP Kubernetes Helm Charts are available on the Tecnisys private registry:

https://registry.tecnisys.com.br

To obtain access credentials, contact Tecnisys support.