Skip to main content
Version 3.0.0

About TDP Kubernetes​

TDP Kubernetes is the cloud-native edition of the Tecnisys Data Platform, designed for Kubernetes cluster deployments. This edition uses Helm Charts for packaging and ArgoCD for GitOps, providing:

  • Declarative deployment via Helm Charts
  • Automated GitOps with ArgoCD
  • Elastic scalability of resources
  • Native integration with the Kubernetes ecosystem
  • Simplified configuration management
  • Support for multiple environments (development, staging, production, etc.)

TDP-K8s deployment is modular and flexible. It orchestrates several components essential to the data lifecycle:

  • Distributed processing: Apache Spark and Trino.
  • Streaming and ingestion: Apache Kafka (Strimzi) and Apache NiFi.
  • Storage and metadata: Hive Metastore, PostgreSQL (metadata database), and Apache Iceberg.
  • Orchestration: Apache Airflow.
  • Analytical storage: ClickHouse.
  • Object storage: Apache Ozone.
  • Governance and security: OpenMetadata and Apache Ranger.
  • Visualization and BI: Apache Superset.
  • Interface and administration: JupyterHub and CloudBeaver.
Figure — TDP Kubernetes overall architecture. Helm Charts and Docker images are stored in the Artifact Registry; TDPCTL or ArgoCD apply configuration to the cluster; data persists in external storage; components are accessed via Gateway API.
Figure — TDP Kubernetes overall architecture. Helm Charts and Docker images are stored in the Artifact Registry; TDPCTL or ArgoCD apply configuration to the cluster; data persists in external storage; components are accessed via Gateway API.

Cloud-native architecture​

TDP Kubernetes adopts a microservices architecture, where each Big Data ecosystem component runs in containers managed by Kubernetes. Helm Charts encapsulate all deployment complexity, while ArgoCD keeps the desired state (Git) continuously aligned with the actual cluster state.

New components​

This edition includes components exclusive to Kubernetes:

  • ClickHouse: High-performance columnar OLAP database
  • CloudBeaver: Web UI for database administration
  • Kubernetes: Container orchestration and workload management

Use cases​

This edition is ideal for:

  • Public cloud deployments (AWS, GCP, and Azure)
  • On-premises Kubernetes environments
  • Cloud-native and microservices architectures
  • Organizations adopting DevOps and GitOps practices
  • Workloads that require dynamic scalability
  • Multi-tenant environments

Helm Charts registry​

TDP Kubernetes Helm Charts are available in Tecnisys’s private registry:

https://registry.tecnisys.com.br

Contact Tecnisys support to obtain access credentials.